[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:00:02 dist-test-slave-vpvm krb5kdc[26026](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:00:02 dist-test-slave-vpvm krb5kdc[26026](info): set up 2 sockets
Aug 12 00:00:02 dist-test-slave-vpvm krb5kdc[26026](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 00:00:03.612015 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.004s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:00:03 dist-test-slave-vpvm krb5kdc[26026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:00:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:00:03.753602 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:35949
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:39065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:35949
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:03.859748 26044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:03.860014 26044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:03.860054 26044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:03.861420 26044 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:03.861471 26044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:03.861491 26044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:03.861507 26044 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:03.861523 26044 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:00:03.864041 26044 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:39065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:35949
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:35949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:03.864464 26044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:03.864724 26044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:03.872509 26053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:03.872406 26052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:03.872357 26044 server_base.cc:1034] running on GCE node
W20260812 00:00:03.872422 26056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:03.873070 26044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:03.873545 26044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:03.874756 26044 hybrid_clock.cc:648] HybridClock initialized: now 1786492803874720 us; error 136 us; skew 500 ppm
Aug 12 00:00:03 dist-test-slave-vpvm krb5kdc[26026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492803, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:03.878118 26044 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:00:03.878865 26044 webserver.cc:460] Webserver started at http://127.25.103.126:33691/ using document root <none> and password file <none>
I20260812 00:00:03.879243 26044 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:03.879310 26044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:03.879506 26044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:03.880831 26044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "102a9d1db50d4ef1ad8f9e6c140265b4"
format_stamp: "Formatted at 2026-08-12 00:00:03 on dist-test-slave-vpvm"
server_key: "565ef0be9ffbbcb224496e86c3de4294"
server_key_iv: "00d6c013b6c23d5280abc801df04d153"
server_key_version: "encryptionkey@0"
I20260812 00:00:03.881240 26044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "102a9d1db50d4ef1ad8f9e6c140265b4"
format_stamp: "Formatted at 2026-08-12 00:00:03 on dist-test-slave-vpvm"
server_key: "565ef0be9ffbbcb224496e86c3de4294"
server_key_iv: "00d6c013b6c23d5280abc801df04d153"
server_key_version: "encryptionkey@0"
I20260812 00:00:03.883359 26044 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 00:00:03.884938 26067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:03.885394 26044 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:03.885572 26044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "102a9d1db50d4ef1ad8f9e6c140265b4"
format_stamp: "Formatted at 2026-08-12 00:00:03 on dist-test-slave-vpvm"
server_key: "565ef0be9ffbbcb224496e86c3de4294"
server_key_iv: "00d6c013b6c23d5280abc801df04d153"
server_key_version: "encryptionkey@0"
I20260812 00:00:03.885694 26044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:03.908368 26044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:03.911185 26044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:03.911554 26044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:03.917728 26044 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:35949
I20260812 00:00:03.917984 26151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:35949 every 8 connection(s)
I20260812 00:00:03.918537 26044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:03.920230 26152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:03.922300 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 26044
I20260812 00:00:03.922417 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:00:03.923471 26013 external_mini_cluster.cc:1428] Setting key 7c74da94b5d196980e6344ace9f468be
I20260812 00:00:03.924057 26152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4: Bootstrap starting.
I20260812 00:00:03.925300 26152 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:03.925755 26152 log.cc:824] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:03.926656 26152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4: No bootstrap required, opened a new log
I20260812 00:00:03.928668 26152 raft_consensus.cc:348] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "102a9d1db50d4ef1ad8f9e6c140265b4" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35949 } }
I20260812 00:00:03.928889 26152 raft_consensus.cc:374] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:03.928990 26152 raft_consensus.cc:729] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 102a9d1db50d4ef1ad8f9e6c140265b4, State: Initialized, Role: FOLLOWER
I20260812 00:00:03.929152 26152 consensus_queue.cc:260] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "102a9d1db50d4ef1ad8f9e6c140265b4" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35949 } }
I20260812 00:00:03.929272 26152 raft_consensus.cc:388] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:03.929312 26152 raft_consensus.cc:482] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:03.929365 26152 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:03.931241 26152 raft_consensus.cc:504] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "102a9d1db50d4ef1ad8f9e6c140265b4" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35949 } }
I20260812 00:00:03.931674 26152 leader_election.cc:302] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 102a9d1db50d4ef1ad8f9e6c140265b4; no voters:
I20260812 00:00:03.932068 26152 leader_election.cc:288] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:00:03.932130 26158 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:03.932323 26158 raft_consensus.cc:686] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4 [term 1 LEADER]: Becoming Leader. State: Replica: 102a9d1db50d4ef1ad8f9e6c140265b4, State: Running, Role: LEADER
I20260812 00:00:03.932510 26158 consensus_queue.cc:237] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "102a9d1db50d4ef1ad8f9e6c140265b4" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35949 } }
I20260812 00:00:03.932785 26152 sys_catalog.cc:564] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:03.933283 26161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 102a9d1db50d4ef1ad8f9e6c140265b4. Latest consensus state: current_term: 1 leader_uuid: "102a9d1db50d4ef1ad8f9e6c140265b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "102a9d1db50d4ef1ad8f9e6c140265b4" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35949 } } }
I20260812 00:00:03.933341 26160 sys_catalog.cc:455] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "102a9d1db50d4ef1ad8f9e6c140265b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "102a9d1db50d4ef1ad8f9e6c140265b4" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35949 } } }
I20260812 00:00:03.933416 26161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:03.933418 26160 sys_catalog.cc:458] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:03.933874 26164 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:03.935649 26164 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:00:03.938947 26164 catalog_manager.cc:1347] Generated new cluster ID: a797f9a49b56474c936e46a73530dfa2
I20260812 00:00:03.939025 26164 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:00:03 dist-test-slave-vpvm krb5kdc[26026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:03.946779 26155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:03.925162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45344 (local address 127.25.103.126:35949)
0812 00:00:03.925581 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:03.925595 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:03.925832 (+ 237us) server_negotiation.cc:407] Connection header received
0812 00:00:03.928671 (+ 2839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:03.928680 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:03.928792 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:03.928963 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:03.930914 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:03.931980 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:03.933496 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:03.934173 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:03.934264 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:03.941175 (+ 6911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:03.941181 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:03.941182 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:03.941201 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:03.943684 (+ 2483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:03.944743 (+ 1059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:03.944749 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:03.944750 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:03.944930 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:03.945318 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:03.945319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:03.945320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:03.945675 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:03.945849 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:03.946232 (+ 383us) server_negotiation.cc:299] Negotiation successful
0812 00:00:03.946473 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":219,"thread_start_us":100,"threads_started":1}
I20260812 00:00:03.951444 26164 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:00:03.952266 26164 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:03.967690 26164 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 102a9d1db50d4ef1ad8f9e6c140265b4: Generated new TSK 0
I20260812 00:00:03.967965 26164 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
I20260812 00:00:04.015506 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:35949
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:39065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:04.146888 26186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:04.147172 26186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:04.147215 26186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:04.148816 26186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:04.148888 26186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:04.148943 26186 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:00:04.151247 26186 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:39065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:35949
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26186
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:04.151652 26186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:04.152027 26186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:04.160784 26196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:04.160920 26195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:04.161175 26186 server_base.cc:1034] running on GCE node
W20260812 00:00:04.161250 26199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:04.161888 26186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:04.162393 26186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:04.163609 26186 hybrid_clock.cc:648] HybridClock initialized: now 1786492804163591 us; error 38 us; skew 500 ppm
Aug 12 00:00:04 dist-test-slave-vpvm krb5kdc[26026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492804, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:04.168190 26186 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:00:04.169222 26186 webserver.cc:460] Webserver started at http://127.25.103.65:46235/ using document root <none> and password file <none>
I20260812 00:00:04.169525 26186 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:04.169590 26186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:04.169725 26186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:04.171300 26186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "ad694c9b2b6d4cad872fab68b5653276"
format_stamp: "Formatted at 2026-08-12 00:00:04 on dist-test-slave-vpvm"
server_key: "8ee0bed354609bf3fca342ee9d408f08"
server_key_iv: "0a3504f4b7e8b13aeb4cf097974cec60"
server_key_version: "encryptionkey@0"
I20260812 00:00:04.171798 26186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "ad694c9b2b6d4cad872fab68b5653276"
format_stamp: "Formatted at 2026-08-12 00:00:04 on dist-test-slave-vpvm"
server_key: "8ee0bed354609bf3fca342ee9d408f08"
server_key_iv: "0a3504f4b7e8b13aeb4cf097974cec60"
server_key_version: "encryptionkey@0"
I20260812 00:00:04.174120 26186 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 00:00:04.175222 26215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:04.175416 26186 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:04.175525 26186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "ad694c9b2b6d4cad872fab68b5653276"
format_stamp: "Formatted at 2026-08-12 00:00:04 on dist-test-slave-vpvm"
server_key: "8ee0bed354609bf3fca342ee9d408f08"
server_key_iv: "0a3504f4b7e8b13aeb4cf097974cec60"
server_key_version: "encryptionkey@0"
I20260812 00:00:04.175625 26186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:04.187918 26186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:04.191149 26186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:04.191295 26186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:04.191635 26186 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:04.192036 26186 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:04.192121 26186 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:04.192152 26186 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:04.192164 26186 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:04.206247 26186 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:43281
I20260812 00:00:04.206413 26406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:43281 every 8 connection(s)
I20260812 00:00:04.206789 26186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:00:04.214598 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 26186
I20260812 00:00:04.214766 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:00:04.214982 26013 external_mini_cluster.cc:1428] Setting key a4ca94f97e4ab1d9d68968c4b76aa522
Aug 12 00:00:04 dist-test-slave-vpvm krb5kdc[26026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492804, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:04.220655 26155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:04.208256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:59493 (local address 127.25.103.126:35949)
0812 00:00:04.208371 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:04.208379 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:04.208494 (+ 115us) server_negotiation.cc:407] Connection header received
0812 00:00:04.210395 (+ 1901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:04.210398 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:04.210417 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:04.210477 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:04.211257 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:04.211789 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:04.212859 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:04.213083 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:04.213142 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:04.216540 (+ 3398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:04.216543 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:04.216543 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:04.216556 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:04.218552 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:04.219294 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:04.219296 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:04.219297 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:04.219420 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:04.219751 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:04.219752 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:04.219752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:04.219903 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:04.219977 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:04.220344 (+ 367us) server_negotiation.cc:299] Negotiation successful
0812 00:00:04.220554 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 00:00:04.220773 26411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:04.208065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35949 (local address 127.25.103.65:59493)
0812 00:00:04.208318 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:04.208383 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:04.210191 (+ 1808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:04.210571 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:04.210576 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:04.210905 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:04.211137 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:04.211142 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:04.211894 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:04.211895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:04.212758 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:04.212760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:04.213168 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:04.213169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:04.213305 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:04.214069 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:04.214083 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:04.216404 (+ 2321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:04.218693 (+ 2289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:04.218710 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:04.218714 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:04.219160 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:04.219500 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:04.219501 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:04.219501 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:04.219657 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:04.219977 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:04.219984 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:04.220175 (+ 191us) client_negotiation.cc:769] Sending connection context
0812 00:00:04.220296 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 00:00:04.220496 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":104,"threads_started":1}
I20260812 00:00:04.221602 26407 heartbeater.cc:347] Connected to a master server at 127.25.103.126:35949
I20260812 00:00:04.221745 26407 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:04.222026 26407 heartbeater.cc:511] Master 127.25.103.126:35949 requested a full tablet report, sending...
I20260812 00:00:04.223182 26093 ts_manager.cc:194] Registered new tserver with Master: ad694c9b2b6d4cad872fab68b5653276 (127.25.103.65:43281)
I20260812 00:00:04.224097 26093 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:59493
WARNING: no policy specified for kudu/127.25.103.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
I20260812 00:00:04.250262 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:35949
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:39065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:04.349048 26415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:04.349292 26415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:04.349319 26415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:04.350611 26415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:04.350657 26415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:04.350685 26415 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:00:04.352262 26415 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:39065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:35949
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:04.352506 26415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:04.352720 26415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:04.358609 26427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:04.358589 26423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:04.358762 26422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:04.359277 26415 server_base.cc:1034] running on GCE node
I20260812 00:00:04.359680 26415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:04.359985 26415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:04.361168 26415 hybrid_clock.cc:648] HybridClock initialized: now 1786492804361146 us; error 45 us; skew 500 ppm
Aug 12 00:00:04 dist-test-slave-vpvm krb5kdc[26026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492804, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:04.364368 26415 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:00:04.364954 26415 webserver.cc:460] Webserver started at http://127.25.103.66:36501/ using document root <none> and password file <none>
I20260812 00:00:04.365212 26415 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:04.365265 26415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:04.365396 26415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:04.366735 26415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "221639d18b2a4172b5c0a8289973b165"
format_stamp: "Formatted at 2026-08-12 00:00:04 on dist-test-slave-vpvm"
server_key: "54403f09fed4bad7cc5d285aed893da7"
server_key_iv: "d1d4c9b4b7e41e65598608166670b077"
server_key_version: "encryptionkey@0"
I20260812 00:00:04.367384 26415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "221639d18b2a4172b5c0a8289973b165"
format_stamp: "Formatted at 2026-08-12 00:00:04 on dist-test-slave-vpvm"
server_key: "54403f09fed4bad7cc5d285aed893da7"
server_key_iv: "d1d4c9b4b7e41e65598608166670b077"
server_key_version: "encryptionkey@0"
I20260812 00:00:04.369750 26415 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260812 00:00:04.370802 26436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:04.371178 26415 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:04.371285 26415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "221639d18b2a4172b5c0a8289973b165"
format_stamp: "Formatted at 2026-08-12 00:00:04 on dist-test-slave-vpvm"
server_key: "54403f09fed4bad7cc5d285aed893da7"
server_key_iv: "d1d4c9b4b7e41e65598608166670b077"
server_key_version: "encryptionkey@0"
I20260812 00:00:04.371361 26415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:04.382476 26415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:04.386428 26415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:04.386615 26415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:04.386876 26415 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:04.387247 26415 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:04.387306 26415 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:04.387338 26415 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:04.387356 26415 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:04.394212 26415 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:33859
I20260812 00:00:04.394503 26621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:33859 every 8 connection(s)
I20260812 00:00:04.394681 26415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:00:04.398685 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 26415
I20260812 00:00:04.398792 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:00:04.398973 26013 external_mini_cluster.cc:1428] Setting key 7e6a1523d4fe90fde6770270c7a3178d
Aug 12 00:00:04 dist-test-slave-vpvm krb5kdc[26026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492804, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:04.408363 26155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:04.395813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:38219 (local address 127.25.103.126:35949)
0812 00:00:04.395920 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:04.395922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:04.395940 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:00:04.396507 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:04.396509 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:04.396531 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:04.396625 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:04.398509 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:04.399237 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:04.400667 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:04.400993 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:04.401150 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:04.404285 (+ 3135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:04.404287 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:04.404288 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:04.404298 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:04.406021 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:04.406612 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:04.406614 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:04.406614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:04.406790 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:04.407504 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:04.407505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:04.407506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:04.407678 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:04.407750 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:04.408120 (+ 370us) server_negotiation.cc:299] Negotiation successful
0812 00:00:04.408244 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 00:00:04.408613 26626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:04.395602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35949 (local address 127.25.103.66:38219)
0812 00:00:04.395784 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:04.395831 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:04.396343 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:04.396807 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:04.396822 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:04.397876 (+ 1054us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:04.398225 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:04.398235 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:04.399359 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:04.399360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:04.400542 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:04.400547 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:04.401112 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:04.401113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:04.401275 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:04.402097 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:04.402106 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:04.404113 (+ 2007us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:04.406150 (+ 2037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:04.406167 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:04.406172 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:04.406521 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:04.407033 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:04.407035 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:04.407036 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:04.407398 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:04.407754 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:04.407763 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:04.407964 (+ 201us) client_negotiation.cc:769] Sending connection context
0812 00:00:04.408078 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 00:00:04.408331 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":78,"threads_started":1}
I20260812 00:00:04.409406 26623 heartbeater.cc:347] Connected to a master server at 127.25.103.126:35949
I20260812 00:00:04.409533 26623 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:04.409767 26623 heartbeater.cc:511] Master 127.25.103.126:35949 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.25.103.67@KRBTEST.COM; defaulting to no policy
I20260812 00:00:04.410318 26093 ts_manager.cc:194] Registered new tserver with Master: 221639d18b2a4172b5c0a8289973b165 (127.25.103.66:33859)
I20260812 00:00:04.410743 26093 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:38219
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
I20260812 00:00:04.435755 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:35949
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:39065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:04.537047 26633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:04.537506 26633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:04.537551 26633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:04.539593 26633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:04.539669 26633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:04.539705 26633 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:00:04.541663 26633 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:39065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:35949
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:04.541935 26633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:04.542250 26633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:04.548916 26640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:04.548986 26646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:04.548916 26642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:04.549706 26633 server_base.cc:1034] running on GCE node
I20260812 00:00:04.550041 26633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:04.550366 26633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:04.551563 26633 hybrid_clock.cc:648] HybridClock initialized: now 1786492804551542 us; error 30 us; skew 500 ppm
Aug 12 00:00:04 dist-test-slave-vpvm krb5kdc[26026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492804, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:04.554628 26633 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:00:04.555166 26633 webserver.cc:460] Webserver started at http://127.25.103.67:40423/ using document root <none> and password file <none>
I20260812 00:00:04.555406 26633 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:04.555459 26633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:04.555600 26633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:04.556849 26633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "c5aab42142994fb0b6d02f60eb29d21d"
format_stamp: "Formatted at 2026-08-12 00:00:04 on dist-test-slave-vpvm"
server_key: "0ecd5dcd9c047d9e3df2525b2bd8dac2"
server_key_iv: "59c50341b0f66bbf23c1bd2bbf46fe01"
server_key_version: "encryptionkey@0"
I20260812 00:00:04.557224 26633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "c5aab42142994fb0b6d02f60eb29d21d"
format_stamp: "Formatted at 2026-08-12 00:00:04 on dist-test-slave-vpvm"
server_key: "0ecd5dcd9c047d9e3df2525b2bd8dac2"
server_key_iv: "59c50341b0f66bbf23c1bd2bbf46fe01"
server_key_version: "encryptionkey@0"
I20260812 00:00:04.559016 26633 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 00:00:04.560434 26656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:04.560755 26633 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:04.560941 26633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "c5aab42142994fb0b6d02f60eb29d21d"
format_stamp: "Formatted at 2026-08-12 00:00:04 on dist-test-slave-vpvm"
server_key: "0ecd5dcd9c047d9e3df2525b2bd8dac2"
server_key_iv: "59c50341b0f66bbf23c1bd2bbf46fe01"
server_key_version: "encryptionkey@0"
I20260812 00:00:04.561061 26633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:04.583556 26633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:04.586870 26633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:04.587028 26633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:04.587280 26633 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:04.587635 26633 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:04.587670 26633 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:04.587694 26633 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:04.587706 26633 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:04.595127 26633 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:35571
I20260812 00:00:04.595281 26826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:35571 every 8 connection(s)
I20260812 00:00:04.595655 26633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:00:04 dist-test-slave-vpvm krb5kdc[26026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492804, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:04.604766 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 26633
I20260812 00:00:04.604851 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:00:04.605046 26013 external_mini_cluster.cc:1428] Setting key 24e777e7b62e57b417d8787101f2f0e8
I20260812 00:00:04.608901 26155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:04.596860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:36925 (local address 127.25.103.126:35949)
0812 00:00:04.596970 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:04.596973 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:04.597167 (+ 194us) server_negotiation.cc:407] Connection header received
0812 00:00:04.597914 (+ 747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:04.597917 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:04.597934 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:04.598102 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:04.599413 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:04.600148 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:04.601748 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:04.602187 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:04.602280 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:04.605451 (+ 3171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:04.605454 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:04.605454 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:04.605466 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:04.606989 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:04.607502 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:04.607504 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:04.607505 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:04.607618 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:04.608071 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:04.608072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:04.608072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:04.608242 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:04.608307 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:04.608735 (+ 428us) server_negotiation.cc:299] Negotiation successful
0812 00:00:04.608824 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 00:00:04.609079 26830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:04.596765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35949 (local address 127.25.103.67:36925)
0812 00:00:04.596992 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:04.597049 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:04.597742 (+ 693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:04.598190 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:04.598194 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:04.598931 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:04.599219 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:04.599225 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:04.600336 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:04.600338 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:04.601595 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:04.601601 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:04.602302 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:04.602303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:04.602477 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:04.603314 (+ 837us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:04.603329 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:04.605278 (+ 1949us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:04.607090 (+ 1812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:04.607100 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:04.607102 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:04.607379 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:04.607783 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:04.607784 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:04.607784 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:04.607927 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:04.608364 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:04.608371 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:04.608553 (+ 182us) client_negotiation.cc:769] Sending connection context
0812 00:00:04.608686 (+ 133us) client_negotiation.cc:240] Negotiation successful
0812 00:00:04.608855 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":114,"threads_started":1}
I20260812 00:00:04.609720 26827 heartbeater.cc:347] Connected to a master server at 127.25.103.126:35949
I20260812 00:00:04.609898 26827 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:04.610193 26827 heartbeater.cc:511] Master 127.25.103.126:35949 requested a full tablet report, sending...
I20260812 00:00:04.610841 26093 ts_manager.cc:194] Registered new tserver with Master: c5aab42142994fb0b6d02f60eb29d21d (127.25.103.67:35571)
I20260812 00:00:04.611281 26093 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:36925
I20260812 00:00:04.617503 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:00:04 dist-test-slave-vpvm krb5kdc[26026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492804, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:00:04 dist-test-slave-vpvm krb5kdc[26026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492804, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.103.65@KRBTEST.COM
I20260812 00:00:04.648854 26843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:04.639454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44240 (local address 127.25.103.65:43281)
0812 00:00:04.639665 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:04.639671 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:04.639683 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:00:04.639711 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:04.639713 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:04.639728 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:04.639798 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:04.640541 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:04.641336 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:04.642415 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:04.642803 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:04.642881 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:04.645524 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:04.645537 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:04.645537 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:04.645546 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:04.647196 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:04.647612 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:04.647615 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:04.647615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:04.647680 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:04.648063 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:04.648064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:04.648065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:04.648238 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:04.648368 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:04.648579 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 00:00:04.648728 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":112,"threads_started":1}
W20260812 00:00:04.649529 26263 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44240
Aug 12 00:00:04 dist-test-slave-vpvm krb5kdc[26026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:00:04 dist-test-slave-vpvm krb5kdc[26026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.65@KRBTEST.COM
I20260812 00:00:04.678460 26843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:04.670052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44252 (local address 127.25.103.65:43281)
0812 00:00:04.670168 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:04.670257 (+ 89us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:04.670308 (+ 51us) server_negotiation.cc:407] Connection header received
0812 00:00:04.670421 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:04.670422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:04.670442 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:04.670494 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:04.671154 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:04.671664 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:04.672439 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:04.672682 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:04.672752 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:04.675237 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:04.675239 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:04.675239 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:04.675248 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:04.676955 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:04.677445 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:04.677446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:04.677447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:04.677510 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:04.677704 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:04.677705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:04.677705 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:04.677838 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:04.677989 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:04.678093 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 00:00:04.678312 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 00:00:04.679231 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 26186
I20260812 00:00:04.711242 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 26415
I20260812 00:00:04.751772 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 26633
I20260812 00:00:04.780306 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 26044
2026-08-12T00:00:04Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2463 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:00:04 dist-test-slave-vpvm krb5kdc[26854](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:00:04 dist-test-slave-vpvm krb5kdc[26854](info): set up 2 sockets
Aug 12 00:00:04 dist-test-slave-vpvm krb5kdc[26854](info): commencing operation
krb5kdc: starting...
W20260812 00:00:06.028256 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.217s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:00:06 dist-test-slave-vpvm krb5kdc[26854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:00:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:00:06.177577 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:35545
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:44287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:35545
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:06.277472 26870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:06.277743 26870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:06.277767 26870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:06.279048 26870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:06.279095 26870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:06.279109 26870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:06.279120 26870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:06.279134 26870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:00:06.280728 26870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:44287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:35545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:35545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:06.280972 26870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:06.281214 26870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:06.287645 26881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:06.287724 26884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:06.287742 26880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:06.288120 26870 server_base.cc:1034] running on GCE node
I20260812 00:00:06.288568 26870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:06.288970 26870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:06.290138 26870 hybrid_clock.cc:648] HybridClock initialized: now 1786492806290113 us; error 45 us; skew 500 ppm
Aug 12 00:00:06 dist-test-slave-vpvm krb5kdc[26854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492806, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:06.293885 26870 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:00:06.294597 26870 webserver.cc:460] Webserver started at http://127.25.103.126:42439/ using document root <none> and password file <none>
I20260812 00:00:06.294893 26870 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:06.294950 26870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:06.295099 26870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:06.296424 26870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "8286baaa8ad247b78c05d7b026138bc2"
format_stamp: "Formatted at 2026-08-12 00:00:06 on dist-test-slave-vpvm"
server_key: "a910dee8b005e7b014b834aaba3a2bd5"
server_key_iv: "8727c32a0ef59d9b42aaaf373a345909"
server_key_version: "encryptionkey@0"
I20260812 00:00:06.296842 26870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "8286baaa8ad247b78c05d7b026138bc2"
format_stamp: "Formatted at 2026-08-12 00:00:06 on dist-test-slave-vpvm"
server_key: "a910dee8b005e7b014b834aaba3a2bd5"
server_key_iv: "8727c32a0ef59d9b42aaaf373a345909"
server_key_version: "encryptionkey@0"
I20260812 00:00:06.298681 26870 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260812 00:00:06.299875 26894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:06.300136 26870 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:00:06.300248 26870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "8286baaa8ad247b78c05d7b026138bc2"
format_stamp: "Formatted at 2026-08-12 00:00:06 on dist-test-slave-vpvm"
server_key: "a910dee8b005e7b014b834aaba3a2bd5"
server_key_iv: "8727c32a0ef59d9b42aaaf373a345909"
server_key_version: "encryptionkey@0"
I20260812 00:00:06.300345 26870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:06.318784 26870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:06.322242 26870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:06.322428 26870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:06.328107 26870 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:35545
I20260812 00:00:06.328166 26982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:35545 every 8 connection(s)
I20260812 00:00:06.328540 26870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:06.329584 26983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:06.332257 26983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2: Bootstrap starting.
I20260812 00:00:06.332939 26983 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:06.333236 26983 log.cc:824] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:06.334649 26983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2: No bootstrap required, opened a new log
I20260812 00:00:06.335574 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 26870
I20260812 00:00:06.335683 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:00:06.335831 26013 external_mini_cluster.cc:1428] Setting key 833af4c29a2fcd9a3e921e80901001ff
I20260812 00:00:06.337571 26983 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8286baaa8ad247b78c05d7b026138bc2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35545 } }
I20260812 00:00:06.337843 26983 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:06.337886 26983 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8286baaa8ad247b78c05d7b026138bc2, State: Initialized, Role: FOLLOWER
I20260812 00:00:06.338065 26983 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8286baaa8ad247b78c05d7b026138bc2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35545 } }
I20260812 00:00:06.338158 26983 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:06.338194 26983 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:06.338258 26983 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:06.339643 26983 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8286baaa8ad247b78c05d7b026138bc2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35545 } }
I20260812 00:00:06.339823 26983 leader_election.cc:302] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8286baaa8ad247b78c05d7b026138bc2; no voters:
I20260812 00:00:06.340068 26983 leader_election.cc:288] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:00:06.340211 26989 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:06.340435 26983 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:06.340530 26989 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2 [term 1 LEADER]: Becoming Leader. State: Replica: 8286baaa8ad247b78c05d7b026138bc2, State: Running, Role: LEADER
I20260812 00:00:06.340728 26989 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8286baaa8ad247b78c05d7b026138bc2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35545 } }
I20260812 00:00:06.341293 26991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8286baaa8ad247b78c05d7b026138bc2. Latest consensus state: current_term: 1 leader_uuid: "8286baaa8ad247b78c05d7b026138bc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8286baaa8ad247b78c05d7b026138bc2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35545 } } }
I20260812 00:00:06.341566 26991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:06.341552 26990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8286baaa8ad247b78c05d7b026138bc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8286baaa8ad247b78c05d7b026138bc2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35545 } } }
I20260812 00:00:06.341792 26990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:06.342275 27000 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:06.343609 27000 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 00:00:06 dist-test-slave-vpvm krb5kdc[26854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:06.347780 27000 catalog_manager.cc:1347] Generated new cluster ID: 572e3fa8b9434a90995c4a1482698435
I20260812 00:00:06.347858 27000 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:00:06.352017 26988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:06.336625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42746 (local address 127.25.103.126:35545)
0812 00:00:06.336921 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:06.336937 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:06.336993 (+ 56us) server_negotiation.cc:407] Connection header received
0812 00:00:06.337507 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:06.337519 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:06.337603 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:06.337831 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:06.338749 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.340929 (+ 2180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.342164 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.342873 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.343016 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:06.346260 (+ 3244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:06.346277 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:06.346278 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:06.346298 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:06.348746 (+ 2448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:06.349377 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:06.349382 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:06.349383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:06.349539 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:06.349866 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:06.349869 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:06.349869 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:06.350523 (+ 654us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:06.351385 (+ 862us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:06.351492 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 00:00:06.351728 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":151,"threads_started":1}
I20260812 00:00:06.359283 27000 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:00:06.360088 27000 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:06.366153 27000 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8286baaa8ad247b78c05d7b026138bc2: Generated new TSK 0
I20260812 00:00:06.366436 27000 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
I20260812 00:00:06.406883 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:35545
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:44287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:06.503507 27020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:06.503794 27020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:06.503830 27020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:06.505193 27020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:06.505251 27020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:06.505283 27020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:00:06.507138 27020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:44287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:35545
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:06.507457 27020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:06.507748 27020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:06.513435 27031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:06.513602 27034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:06.513480 27032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:06.513633 27020 server_base.cc:1034] running on GCE node
I20260812 00:00:06.513991 27020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:06.514277 27020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:06.515482 27020 hybrid_clock.cc:648] HybridClock initialized: now 1786492806515455 us; error 62 us; skew 500 ppm
Aug 12 00:00:06 dist-test-slave-vpvm krb5kdc[26854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492806, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:06.519134 27020 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:00:06.520022 27020 webserver.cc:460] Webserver started at http://127.25.103.65:45569/ using document root <none> and password file <none>
I20260812 00:00:06.520303 27020 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:06.520359 27020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:06.520656 27020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:06.522094 27020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "0c88ee6e87a64c5ebdcbc0cc658d2fa7"
format_stamp: "Formatted at 2026-08-12 00:00:06 on dist-test-slave-vpvm"
server_key: "af40dedb9e2233d668cd59f3c55f0fba"
server_key_iv: "1faf65d7eadb4577102e01f734e2d780"
server_key_version: "encryptionkey@0"
I20260812 00:00:06.522488 27020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "0c88ee6e87a64c5ebdcbc0cc658d2fa7"
format_stamp: "Formatted at 2026-08-12 00:00:06 on dist-test-slave-vpvm"
server_key: "af40dedb9e2233d668cd59f3c55f0fba"
server_key_iv: "1faf65d7eadb4577102e01f734e2d780"
server_key_version: "encryptionkey@0"
I20260812 00:00:06.524297 27020 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 00:00:06.525422 27047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:06.525692 27020 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:06.525802 27020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "0c88ee6e87a64c5ebdcbc0cc658d2fa7"
format_stamp: "Formatted at 2026-08-12 00:00:06 on dist-test-slave-vpvm"
server_key: "af40dedb9e2233d668cd59f3c55f0fba"
server_key_iv: "1faf65d7eadb4577102e01f734e2d780"
server_key_version: "encryptionkey@0"
I20260812 00:00:06.525892 27020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:06.548732 27020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:06.551128 27020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:06.551285 27020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:06.551532 27020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:06.551882 27020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:06.551918 27020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:06.551947 27020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:06.551971 27020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:06.559101 27020 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:43823
I20260812 00:00:06.559181 27238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:43823 every 8 connection(s)
I20260812 00:00:06.559612 27020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:00:06.563843 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 27020
I20260812 00:00:06.563990 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:00:06.564193 26013 external_mini_cluster.cc:1428] Setting key 856af4f1b40819fc42e773d9ef752590
Aug 12 00:00:06 dist-test-slave-vpvm krb5kdc[26854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492806, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:06.572122 26988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:06.560667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:43989 (local address 127.25.103.126:35545)
0812 00:00:06.560725 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:06.560728 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:06.560956 (+ 228us) server_negotiation.cc:407] Connection header received
0812 00:00:06.562472 (+ 1516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:06.562475 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:06.562504 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:06.562566 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:06.563426 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.564404 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.566091 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.566311 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.566384 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:06.569196 (+ 2812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:06.569198 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:06.569199 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:06.569208 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:06.570616 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:06.571101 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:06.571102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:06.571102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:06.571164 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:06.571411 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:06.571412 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:06.571412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:06.571551 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:06.571613 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:06.571906 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 00:00:06.572021 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:00:06.572316 27245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:06.560617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35545 (local address 127.25.103.65:43989)
0812 00:00:06.560823 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:06.560864 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:06.562256 (+ 1392us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:06.562680 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:06.562687 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:06.563026 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:06.563321 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:06.563326 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.564608 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.564610 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:06.565931 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:06.565937 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.566413 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.566415 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:06.566585 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:06.567300 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:06.567312 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:06.569075 (+ 1763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:06.570718 (+ 1643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:06.570729 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:06.570732 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:06.571026 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:06.571222 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:06.571223 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:06.571224 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:06.571349 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:06.571611 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:06.571619 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:06.571780 (+ 161us) client_negotiation.cc:769] Sending connection context
0812 00:00:06.571877 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 00:00:06.572067 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":105,"threads_started":1}
I20260812 00:00:06.572794 27241 heartbeater.cc:347] Connected to a master server at 127.25.103.126:35545
I20260812 00:00:06.572904 27241 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:06.573103 27241 heartbeater.cc:511] Master 127.25.103.126:35545 requested a full tablet report, sending...
I20260812 00:00:06.573666 26924 ts_manager.cc:194] Registered new tserver with Master: 0c88ee6e87a64c5ebdcbc0cc658d2fa7 (127.25.103.65:43823)
I20260812 00:00:06.574409 26924 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:43989
WARNING: no policy specified for kudu/127.25.103.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
I20260812 00:00:06.597084 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:35545
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:44287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:06.693040 27250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:06.693343 27250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:06.693373 27250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:06.695837 27250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:06.695945 27250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:06.695983 27250 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:00:06.697806 27250 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:44287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:35545
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:06.698130 27250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:06.698415 27250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:06.704522 27262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:06.704645 27257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:06.704522 27260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:06.704913 27250 server_base.cc:1034] running on GCE node
I20260812 00:00:06.705174 27250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:06.705710 27250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:06.706936 27250 hybrid_clock.cc:648] HybridClock initialized: now 1786492806706892 us; error 59 us; skew 500 ppm
Aug 12 00:00:06 dist-test-slave-vpvm krb5kdc[26854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492806, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:06.710282 27250 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:00:06.710875 27250 webserver.cc:460] Webserver started at http://127.25.103.66:38341/ using document root <none> and password file <none>
I20260812 00:00:06.711086 27250 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:06.711133 27250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:06.711243 27250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:06.712400 27250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "95abd74d689f4441802b168a90c16556"
format_stamp: "Formatted at 2026-08-12 00:00:06 on dist-test-slave-vpvm"
server_key: "d431a26dff69d369e0580e28cddc4521"
server_key_iv: "ce042b5f41ab8cdc7bae901afa373fb8"
server_key_version: "encryptionkey@0"
I20260812 00:00:06.712761 27250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "95abd74d689f4441802b168a90c16556"
format_stamp: "Formatted at 2026-08-12 00:00:06 on dist-test-slave-vpvm"
server_key: "d431a26dff69d369e0580e28cddc4521"
server_key_iv: "ce042b5f41ab8cdc7bae901afa373fb8"
server_key_version: "encryptionkey@0"
I20260812 00:00:06.714327 27250 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:00:06.715349 27279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:06.715619 27250 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:06.715778 27250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "95abd74d689f4441802b168a90c16556"
format_stamp: "Formatted at 2026-08-12 00:00:06 on dist-test-slave-vpvm"
server_key: "d431a26dff69d369e0580e28cddc4521"
server_key_iv: "ce042b5f41ab8cdc7bae901afa373fb8"
server_key_version: "encryptionkey@0"
I20260812 00:00:06.715884 27250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:06.731986 27250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:06.734417 27250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:06.734561 27250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:06.734786 27250 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:06.735111 27250 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:06.735144 27250 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:06.735167 27250 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:06.735185 27250 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:06.741566 27250 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:41153
I20260812 00:00:06.741636 27455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:41153 every 8 connection(s)
I20260812 00:00:06.741981 27250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:00:06.744283 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 27250
I20260812 00:00:06.744400 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:00:06.744560 26013 external_mini_cluster.cc:1428] Setting key fe1b8847d543f943ca722402e7f66f0b
Aug 12 00:00:06 dist-test-slave-vpvm krb5kdc[26854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492806, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:06.754885 26988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:06.742831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:34063 (local address 127.25.103.126:35545)
0812 00:00:06.742986 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:06.742988 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:06.743039 (+ 51us) server_negotiation.cc:407] Connection header received
0812 00:00:06.744055 (+ 1016us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:06.744057 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:06.744070 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:06.744123 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:06.744877 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.745539 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.747498 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.747726 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.747808 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:06.751207 (+ 3399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:06.751209 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:06.751210 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:06.751222 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:06.752926 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:06.753583 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:06.753585 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:06.753586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:06.753674 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:06.754046 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:06.754047 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:06.754048 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:06.754190 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:06.754253 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:06.754717 (+ 464us) server_negotiation.cc:299] Negotiation successful
0812 00:00:06.754812 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260812 00:00:06.755147 27461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:06.742741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35545 (local address 127.25.103.66:34063)
0812 00:00:06.742911 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:06.742960 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:06.743940 (+ 980us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:06.744204 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:06.744209 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:06.744538 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:06.744787 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:06.744793 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.745693 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.745695 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:06.747266 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:06.747274 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.747849 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.747850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:06.748046 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:06.748996 (+ 950us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:06.749010 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:06.751002 (+ 1992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:06.753063 (+ 2061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:06.753076 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:06.753079 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:06.753448 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:06.753750 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:06.753750 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:06.753751 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:06.753908 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:06.754284 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:06.754293 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:06.754521 (+ 228us) client_negotiation.cc:769] Sending connection context
0812 00:00:06.754658 (+ 137us) client_negotiation.cc:240] Negotiation successful
0812 00:00:06.754868 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":69,"threads_started":1}
I20260812 00:00:06.755838 27458 heartbeater.cc:347] Connected to a master server at 127.25.103.126:35545
WARNING: no policy specified for kudu/127.25.103.67@KRBTEST.COM; defaulting to no policy
I20260812 00:00:06.755947 27458 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:06.756140 27458 heartbeater.cc:511] Master 127.25.103.126:35545 requested a full tablet report, sending...
I20260812 00:00:06.756506 26924 ts_manager.cc:194] Registered new tserver with Master: 95abd74d689f4441802b168a90c16556 (127.25.103.66:41153)
I20260812 00:00:06.756893 26924 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:34063
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
I20260812 00:00:06.779264 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:35545
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:44287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:06.879199 27465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:06.879596 27465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:06.879684 27465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:06.882205 27465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:06.882290 27465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:06.882336 27465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:00:06.885254 27465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:44287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:35545
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:06.885614 27465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:06.885881 27465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:06.891634 27475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:06.891634 27474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:06.891693 27478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:06.891840 27465 server_base.cc:1034] running on GCE node
I20260812 00:00:06.892210 27465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:06.892510 27465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:06.893708 27465 hybrid_clock.cc:648] HybridClock initialized: now 1786492806893685 us; error 40 us; skew 500 ppm
Aug 12 00:00:06 dist-test-slave-vpvm krb5kdc[26854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492806, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:06.897113 27465 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:00:06.897677 27465 webserver.cc:460] Webserver started at http://127.25.103.67:44469/ using document root <none> and password file <none>
I20260812 00:00:06.897938 27465 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:06.898034 27465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:06.898164 27465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:06.899355 27465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "d36e4f8a99ba41e89c9cd7b06bee13c5"
format_stamp: "Formatted at 2026-08-12 00:00:06 on dist-test-slave-vpvm"
server_key: "8ca410a25c9ebf28f7305923fd93ae03"
server_key_iv: "0da05d27beeaa34c7502be986370917d"
server_key_version: "encryptionkey@0"
I20260812 00:00:06.899717 27465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "d36e4f8a99ba41e89c9cd7b06bee13c5"
format_stamp: "Formatted at 2026-08-12 00:00:06 on dist-test-slave-vpvm"
server_key: "8ca410a25c9ebf28f7305923fd93ae03"
server_key_iv: "0da05d27beeaa34c7502be986370917d"
server_key_version: "encryptionkey@0"
I20260812 00:00:06.901440 27465 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260812 00:00:06.902824 27486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:06.903059 27465 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:06.903182 27465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "d36e4f8a99ba41e89c9cd7b06bee13c5"
format_stamp: "Formatted at 2026-08-12 00:00:06 on dist-test-slave-vpvm"
server_key: "8ca410a25c9ebf28f7305923fd93ae03"
server_key_iv: "0da05d27beeaa34c7502be986370917d"
server_key_version: "encryptionkey@0"
I20260812 00:00:06.903262 27465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:06.923152 27465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:06.926167 27465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:06.926311 27465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:06.926585 27465 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:06.926895 27465 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:06.926928 27465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:06.926952 27465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:06.926970 27465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:06.935765 27465 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:39089
I20260812 00:00:06.935832 27669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:39089 every 8 connection(s)
I20260812 00:00:06.936178 27465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:00:06.937459 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 27465
I20260812 00:00:06.937553 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:00:06.937705 26013 external_mini_cluster.cc:1428] Setting key a68e3a8876b49502dd1a7309d7b98429
Aug 12 00:00:06 dist-test-slave-vpvm krb5kdc[26854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492806, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:06.949615 26988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:06.937275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:58247 (local address 127.25.103.126:35545)
0812 00:00:06.937395 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:06.937397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:06.937640 (+ 243us) server_negotiation.cc:407] Connection header received
0812 00:00:06.939103 (+ 1463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:06.939105 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:06.939119 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:06.939345 (+ 226us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:06.940459 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.941042 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.942487 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.942708 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.942777 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:06.945795 (+ 3018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:06.945797 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:06.945797 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:06.945807 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:06.947360 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:06.948050 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:06.948051 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:06.948052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:06.948141 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:06.948628 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:06.948629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:06.948629 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:06.948788 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:06.948860 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:06.949364 (+ 504us) server_negotiation.cc:299] Negotiation successful
0812 00:00:06.949496 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:00:06.949846 27675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:06.937177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35545 (local address 127.25.103.67:58247)
0812 00:00:06.937447 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:06.937501 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:06.938959 (+ 1458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:06.939526 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:06.939531 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:06.940031 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:06.940326 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:06.940334 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.941163 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.941164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:06.942350 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:06.942353 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.942815 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.942816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:06.942946 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:06.943620 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:06.943630 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:06.945645 (+ 2015us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:06.947505 (+ 1860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:06.947515 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:06.947517 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:06.947928 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:06.948335 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:06.948337 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:06.948337 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:06.948526 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:06.948937 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:06.948945 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:06.949121 (+ 176us) client_negotiation.cc:769] Sending connection context
0812 00:00:06.949260 (+ 139us) client_negotiation.cc:240] Negotiation successful
0812 00:00:06.949497 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":112,"threads_started":1}
I20260812 00:00:06.950361 27670 heartbeater.cc:347] Connected to a master server at 127.25.103.126:35545
I20260812 00:00:06.950467 27670 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:06.950634 27670 heartbeater.cc:511] Master 127.25.103.126:35545 requested a full tablet report, sending...
I20260812 00:00:06.951011 26924 ts_manager.cc:194] Registered new tserver with Master: d36e4f8a99ba41e89c9cd7b06bee13c5 (127.25.103.67:39089)
I20260812 00:00:06.951382 26924 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:58247
I20260812 00:00:06.961825 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:00:06.972105 26988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:06.964896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42762 (local address 127.25.103.126:35545)
0812 00:00:06.964991 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:06.964993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:06.965100 (+ 107us) server_negotiation.cc:407] Connection header received
0812 00:00:06.965177 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:06.965178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:06.965190 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:06.965237 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:06.965942 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.966498 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.967284 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.967481 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.967539 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:06.969154 (+ 1615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:06.969156 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:06.969156 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:06.969166 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:06.970873 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:06.971296 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:06.971297 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:06.971298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:06.971356 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:06.971527 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:06.971528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:06.971528 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:06.971698 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:06.971791 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:06.971916 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 00:00:06.972004 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 00:00:06.976019 26924 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42762:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:00:06.978142 26924 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:00:06.987843 27686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:06.982721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:41153 (local address 127.0.0.1:41590)
0812 00:00:06.982958 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:06.983013 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:06.983103 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:06.983867 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:06.983870 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:06.983873 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:06.983995 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:06.983998 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.985174 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.985176 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:06.986593 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:06.986597 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.987492 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.987493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:06.987590 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:06.987603 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 00:00:06.987670 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 00:00:06.987738 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":1,"thread_start_us":132,"threads_started":1}
I20260812 00:00:06.987939 27691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:06.983106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47928 (local address 127.25.103.65:43823)
0812 00:00:06.983525 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:06.983531 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:06.983724 (+ 193us) server_negotiation.cc:407] Connection header received
0812 00:00:06.983819 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:06.983821 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:06.983838 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:06.983912 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:06.984244 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.985390 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.986811 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.987585 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.987669 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:06.987726 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:06.987803 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 00:00:06.987851 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":151,"threads_started":1}
I20260812 00:00:06.987954 27688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:06.982722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:43823 (local address 127.0.0.1:47928)
0812 00:00:06.983593 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:06.983603 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:06.983683 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:06.984030 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:06.984031 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:06.984035 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:06.984139 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:06.984142 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.985527 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.985528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:06.986616 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:06.986618 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.987675 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.987676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:06.987734 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:06.987738 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:00:06.987788 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 00:00:06.987824 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":846,"mutex_wait_us":2,"thread_start_us":82,"threads_started":1}
I20260812 00:00:06.988161 27692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:06.983285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41590 (local address 127.25.103.66:41153)
0812 00:00:06.983636 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:06.983641 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:06.983656 (+ 15us) server_negotiation.cc:407] Connection header received
0812 00:00:06.983716 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:06.983719 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:06.983740 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:06.983857 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:06.984068 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.985065 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.986709 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.987388 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.987473 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:06.987543 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:06.988024 (+ 481us) server_negotiation.cc:299] Negotiation successful
0812 00:00:06.988078 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":236,"threads_started":1}
I20260812 00:00:06.988595 27687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:06.982743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:39089 (local address 127.0.0.1:35592)
0812 00:00:06.983651 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:06.983660 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:06.983751 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:06.984035 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:06.984036 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:06.984038 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:06.984081 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:06.984083 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.986083 (+ 2000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.986084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:06.986964 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:06.986968 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.988320 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.988321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:06.988391 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:06.988397 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:00:06.988480 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 00:00:06.988524 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":889,"thread_start_us":122,"threads_started":1}
I20260812 00:00:06.988636 27690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:06.982957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35592 (local address 127.25.103.67:39089)
0812 00:00:06.983405 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:06.983410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:06.983724 (+ 314us) server_negotiation.cc:407] Connection header received
0812 00:00:06.983833 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:06.983836 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:06.983856 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:06.983936 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:06.984149 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.985398 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.987130 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:06.987890 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:06.987997 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:06.988060 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:06.988505 (+ 445us) server_negotiation.cc:299] Negotiation successful
0812 00:00:06.988563 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":103,"threads_started":1}
I20260812 00:00:06.988900 27352 tablet_service.cc:1467] Processing CreateTablet for tablet e1eb3efafb924641a49018119489510d (DEFAULT_TABLE table=test-table [id=d541c9e0a7dc4f59bd8f8f560182c945]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:06.989252 27352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1eb3efafb924641a49018119489510d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:06.990948 27137 tablet_service.cc:1467] Processing CreateTablet for tablet e1eb3efafb924641a49018119489510d (DEFAULT_TABLE table=test-table [id=d541c9e0a7dc4f59bd8f8f560182c945]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:06.991338 27137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1eb3efafb924641a49018119489510d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:06.992694 27694 tablet_bootstrap.cc:492] T e1eb3efafb924641a49018119489510d P 95abd74d689f4441802b168a90c16556: Bootstrap starting.
I20260812 00:00:06.993506 27694 tablet_bootstrap.cc:654] T e1eb3efafb924641a49018119489510d P 95abd74d689f4441802b168a90c16556: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:06.993595 27564 tablet_service.cc:1467] Processing CreateTablet for tablet e1eb3efafb924641a49018119489510d (DEFAULT_TABLE table=test-table [id=d541c9e0a7dc4f59bd8f8f560182c945]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:06.994048 27564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1eb3efafb924641a49018119489510d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:06.994369 27694 log.cc:824] T e1eb3efafb924641a49018119489510d P 95abd74d689f4441802b168a90c16556: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:06.995678 27694 tablet_bootstrap.cc:492] T e1eb3efafb924641a49018119489510d P 95abd74d689f4441802b168a90c16556: No bootstrap required, opened a new log
I20260812 00:00:06.995769 27694 ts_tablet_manager.cc:1397] T e1eb3efafb924641a49018119489510d P 95abd74d689f4441802b168a90c16556: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:00:06.998225 27700 tablet_bootstrap.cc:492] T e1eb3efafb924641a49018119489510d P 0c88ee6e87a64c5ebdcbc0cc658d2fa7: Bootstrap starting.
I20260812 00:00:06.998430 27694 raft_consensus.cc:348] T e1eb3efafb924641a49018119489510d P 95abd74d689f4441802b168a90c16556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95abd74d689f4441802b168a90c16556" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41153 } } peers { permanent_uuid: "0c88ee6e87a64c5ebdcbc0cc658d2fa7" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43823 } } peers { permanent_uuid: "d36e4f8a99ba41e89c9cd7b06bee13c5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 39089 } }
I20260812 00:00:06.998725 27694 raft_consensus.cc:374] T e1eb3efafb924641a49018119489510d P 95abd74d689f4441802b168a90c16556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:06.998792 27694 raft_consensus.cc:729] T e1eb3efafb924641a49018119489510d P 95abd74d689f4441802b168a90c16556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95abd74d689f4441802b168a90c16556, State: Initialized, Role: FOLLOWER
I20260812 00:00:06.998955 27694 consensus_queue.cc:260] T e1eb3efafb924641a49018119489510d P 95abd74d689f4441802b168a90c16556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95abd74d689f4441802b168a90c16556" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41153 } } peers { permanent_uuid: "0c88ee6e87a64c5ebdcbc0cc658d2fa7" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43823 } } peers { permanent_uuid: "d36e4f8a99ba41e89c9cd7b06bee13c5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 39089 } }
I20260812 00:00:06.999078 27700 tablet_bootstrap.cc:654] T e1eb3efafb924641a49018119489510d P 0c88ee6e87a64c5ebdcbc0cc658d2fa7: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:06.999322 27694 ts_tablet_manager.cc:1428] T e1eb3efafb924641a49018119489510d P 95abd74d689f4441802b168a90c16556: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260812 00:00:06.999563 27458 heartbeater.cc:503] Master 127.25.103.126:35545 was elected leader, sending a full tablet report...
I20260812 00:00:06.999683 27700 log.cc:824] T e1eb3efafb924641a49018119489510d P 0c88ee6e87a64c5ebdcbc0cc658d2fa7: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:07.000141 27701 tablet_bootstrap.cc:492] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5: Bootstrap starting.
I20260812 00:00:07.000761 27700 tablet_bootstrap.cc:492] T e1eb3efafb924641a49018119489510d P 0c88ee6e87a64c5ebdcbc0cc658d2fa7: No bootstrap required, opened a new log
I20260812 00:00:07.000847 27700 ts_tablet_manager.cc:1397] T e1eb3efafb924641a49018119489510d P 0c88ee6e87a64c5ebdcbc0cc658d2fa7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:00:07.001240 27701 tablet_bootstrap.cc:654] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:07.001888 27701 log.cc:824] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:07.003209 27701 tablet_bootstrap.cc:492] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5: No bootstrap required, opened a new log
I20260812 00:00:07.003098 27700 raft_consensus.cc:348] T e1eb3efafb924641a49018119489510d P 0c88ee6e87a64c5ebdcbc0cc658d2fa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95abd74d689f4441802b168a90c16556" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41153 } } peers { permanent_uuid: "0c88ee6e87a64c5ebdcbc0cc658d2fa7" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43823 } } peers { permanent_uuid: "d36e4f8a99ba41e89c9cd7b06bee13c5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 39089 } }
I20260812 00:00:07.003309 27701 ts_tablet_manager.cc:1397] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260812 00:00:07.003340 27700 raft_consensus.cc:374] T e1eb3efafb924641a49018119489510d P 0c88ee6e87a64c5ebdcbc0cc658d2fa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:07.003520 27700 raft_consensus.cc:729] T e1eb3efafb924641a49018119489510d P 0c88ee6e87a64c5ebdcbc0cc658d2fa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c88ee6e87a64c5ebdcbc0cc658d2fa7, State: Initialized, Role: FOLLOWER
I20260812 00:00:07.003892 27700 consensus_queue.cc:260] T e1eb3efafb924641a49018119489510d P 0c88ee6e87a64c5ebdcbc0cc658d2fa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95abd74d689f4441802b168a90c16556" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41153 } } peers { permanent_uuid: "0c88ee6e87a64c5ebdcbc0cc658d2fa7" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43823 } } peers { permanent_uuid: "d36e4f8a99ba41e89c9cd7b06bee13c5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 39089 } }
I20260812 00:00:07.004311 27700 ts_tablet_manager.cc:1428] T e1eb3efafb924641a49018119489510d P 0c88ee6e87a64c5ebdcbc0cc658d2fa7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:00:07.004396 27241 heartbeater.cc:503] Master 127.25.103.126:35545 was elected leader, sending a full tablet report...
I20260812 00:00:07.005831 27701 raft_consensus.cc:348] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95abd74d689f4441802b168a90c16556" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41153 } } peers { permanent_uuid: "0c88ee6e87a64c5ebdcbc0cc658d2fa7" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43823 } } peers { permanent_uuid: "d36e4f8a99ba41e89c9cd7b06bee13c5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 39089 } }
I20260812 00:00:07.006122 27701 raft_consensus.cc:374] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:07.006156 27701 raft_consensus.cc:729] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36e4f8a99ba41e89c9cd7b06bee13c5, State: Initialized, Role: FOLLOWER
I20260812 00:00:07.006263 27701 consensus_queue.cc:260] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95abd74d689f4441802b168a90c16556" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41153 } } peers { permanent_uuid: "0c88ee6e87a64c5ebdcbc0cc658d2fa7" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43823 } } peers { permanent_uuid: "d36e4f8a99ba41e89c9cd7b06bee13c5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 39089 } }
I20260812 00:00:07.006531 27701 ts_tablet_manager.cc:1428] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 00:00:07.006626 27670 heartbeater.cc:503] Master 127.25.103.126:35545 was elected leader, sending a full tablet report...
W20260812 00:00:07.060535 27243 tablet.cc:2369] T e1eb3efafb924641a49018119489510d P 0c88ee6e87a64c5ebdcbc0cc658d2fa7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:00:07.186884 27671 tablet.cc:2369] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:00:07.242762 27460 tablet.cc:2369] T e1eb3efafb924641a49018119489510d P 95abd74d689f4441802b168a90c16556: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:00:07.408874 27707 raft_consensus.cc:482] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:00:07.409041 27707 raft_consensus.cc:504] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95abd74d689f4441802b168a90c16556" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41153 } } peers { permanent_uuid: "0c88ee6e87a64c5ebdcbc0cc658d2fa7" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43823 } } peers { permanent_uuid: "d36e4f8a99ba41e89c9cd7b06bee13c5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 39089 } }
I20260812 00:00:07.409688 27707 leader_election.cc:288] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95abd74d689f4441802b168a90c16556 (127.25.103.66:41153), 0c88ee6e87a64c5ebdcbc0cc658d2fa7 (127.25.103.65:43823)
I20260812 00:00:07.413467 27675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:07.409939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:43823 (local address 127.25.103.67:46151)
0812 00:00:07.410030 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:07.410045 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:07.410107 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:07.410425 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:07.410427 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:07.410431 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:07.410573 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:07.410576 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:07.411556 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:07.411557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:07.412470 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:07.412473 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:07.413132 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:07.413133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:07.413240 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:07.413246 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:00:07.413315 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 00:00:07.413378 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 00:00:07.413527 27691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:07.410056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:46151 (local address 127.25.103.65:43823)
0812 00:00:07.410103 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:07.410105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:07.410118 (+ 13us) server_negotiation.cc:407] Connection header received
0812 00:00:07.410194 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:07.410196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:07.410207 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:07.410280 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:07.410750 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:07.411410 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:07.412612 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:07.413016 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:07.413082 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:07.413091 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:07.413350 (+ 259us) server_negotiation.cc:299] Negotiation successful
0812 00:00:07.413418 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:00:07.413617 27708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:07.410049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:41153 (local address 127.25.103.67:41597)
0812 00:00:07.410220 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:07.410231 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:07.410297 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:07.410607 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:07.410609 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:07.410612 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:07.410730 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:07.410734 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:07.411561 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:07.411562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:07.412611 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:07.412615 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:07.413338 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:07.413340 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:07.413424 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:07.413429 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:00:07.413498 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 00:00:07.413542 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":104,"threads_started":1}
I20260812 00:00:07.413632 27692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:07.410105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:41597 (local address 127.25.103.66:41153)
0812 00:00:07.410161 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:07.410163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:07.410363 (+ 200us) server_negotiation.cc:407] Connection header received
0812 00:00:07.410424 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:07.410426 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:07.410442 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:07.410568 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:07.410879 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:07.411429 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:07.412750 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:07.413213 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:07.413315 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:07.413324 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:07.413513 (+ 189us) server_negotiation.cc:299] Negotiation successful
0812 00:00:07.413561 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:00:07.413985 27162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1eb3efafb924641a49018119489510d" candidate_uuid: "d36e4f8a99ba41e89c9cd7b06bee13c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c88ee6e87a64c5ebdcbc0cc658d2fa7" is_pre_election: true
I20260812 00:00:07.414036 27386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1eb3efafb924641a49018119489510d" candidate_uuid: "d36e4f8a99ba41e89c9cd7b06bee13c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95abd74d689f4441802b168a90c16556" is_pre_election: true
I20260812 00:00:07.414237 27386 raft_consensus.cc:2454] T e1eb3efafb924641a49018119489510d P 95abd74d689f4441802b168a90c16556 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d36e4f8a99ba41e89c9cd7b06bee13c5 in term 0.
I20260812 00:00:07.414237 27162 raft_consensus.cc:2454] T e1eb3efafb924641a49018119489510d P 0c88ee6e87a64c5ebdcbc0cc658d2fa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d36e4f8a99ba41e89c9cd7b06bee13c5 in term 0.
I20260812 00:00:07.414592 27487 leader_election.cc:302] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95abd74d689f4441802b168a90c16556, d36e4f8a99ba41e89c9cd7b06bee13c5; no voters:
I20260812 00:00:07.414727 27707 raft_consensus.cc:2781] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:00:07.414790 27707 raft_consensus.cc:482] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:00:07.414809 27707 raft_consensus.cc:3037] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:07.415624 27707 raft_consensus.cc:504] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95abd74d689f4441802b168a90c16556" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41153 } } peers { permanent_uuid: "0c88ee6e87a64c5ebdcbc0cc658d2fa7" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43823 } } peers { permanent_uuid: "d36e4f8a99ba41e89c9cd7b06bee13c5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 39089 } }
I20260812 00:00:07.415771 27707 leader_election.cc:288] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5 [CANDIDATE]: Term 1 election: Requested vote from peers 95abd74d689f4441802b168a90c16556 (127.25.103.66:41153), 0c88ee6e87a64c5ebdcbc0cc658d2fa7 (127.25.103.65:43823)
I20260812 00:00:07.415972 27386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1eb3efafb924641a49018119489510d" candidate_uuid: "d36e4f8a99ba41e89c9cd7b06bee13c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95abd74d689f4441802b168a90c16556"
I20260812 00:00:07.415985 27162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1eb3efafb924641a49018119489510d" candidate_uuid: "d36e4f8a99ba41e89c9cd7b06bee13c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c88ee6e87a64c5ebdcbc0cc658d2fa7"
I20260812 00:00:07.416064 27386 raft_consensus.cc:3037] T e1eb3efafb924641a49018119489510d P 95abd74d689f4441802b168a90c16556 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:07.416071 27162 raft_consensus.cc:3037] T e1eb3efafb924641a49018119489510d P 0c88ee6e87a64c5ebdcbc0cc658d2fa7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:07.416819 27386 raft_consensus.cc:2454] T e1eb3efafb924641a49018119489510d P 95abd74d689f4441802b168a90c16556 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d36e4f8a99ba41e89c9cd7b06bee13c5 in term 1.
I20260812 00:00:07.416826 27162 raft_consensus.cc:2454] T e1eb3efafb924641a49018119489510d P 0c88ee6e87a64c5ebdcbc0cc658d2fa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d36e4f8a99ba41e89c9cd7b06bee13c5 in term 1.
I20260812 00:00:07.417026 27492 leader_election.cc:302] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c88ee6e87a64c5ebdcbc0cc658d2fa7, d36e4f8a99ba41e89c9cd7b06bee13c5; no voters:
I20260812 00:00:07.417147 27707 raft_consensus.cc:2781] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:07.417337 27707 raft_consensus.cc:686] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5 [term 1 LEADER]: Becoming Leader. State: Replica: d36e4f8a99ba41e89c9cd7b06bee13c5, State: Running, Role: LEADER
I20260812 00:00:07.417440 27707 consensus_queue.cc:237] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95abd74d689f4441802b168a90c16556" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41153 } } peers { permanent_uuid: "0c88ee6e87a64c5ebdcbc0cc658d2fa7" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43823 } } peers { permanent_uuid: "d36e4f8a99ba41e89c9cd7b06bee13c5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 39089 } }
I20260812 00:00:07.418972 26923 catalog_manager.cc:5495] T e1eb3efafb924641a49018119489510d P d36e4f8a99ba41e89c9cd7b06bee13c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d36e4f8a99ba41e89c9cd7b06bee13c5 (127.25.103.67). New cstate: current_term: 1 leader_uuid: "d36e4f8a99ba41e89c9cd7b06bee13c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95abd74d689f4441802b168a90c16556" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c88ee6e87a64c5ebdcbc0cc658d2fa7" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d36e4f8a99ba41e89c9cd7b06bee13c5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 39089 } health_report { overall_health: HEALTHY } } }
Aug 12 00:00:07 dist-test-slave-vpvm krb5kdc[26854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.65@KRBTEST.COM
I20260812 00:00:07.446015 27691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:07.433229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47934 (local address 127.25.103.65:43823)
0812 00:00:07.433306 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:07.433308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:07.433383 (+ 75us) server_negotiation.cc:407] Connection header received
0812 00:00:07.433478 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:07.433479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:07.433490 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:07.433538 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:07.434201 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:07.434807 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:07.435692 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:07.435901 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:07.435964 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:07.442680 (+ 6716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:07.442698 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:07.442698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:07.442708 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:07.444656 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:07.445109 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:07.445113 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:07.445113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:07.445182 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:07.445361 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:07.445361 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:07.445362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:07.445535 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:07.445677 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:07.445768 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 00:00:07.445867 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
Aug 12 00:00:07 dist-test-slave-vpvm krb5kdc[26854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492807, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:00:07 dist-test-slave-vpvm krb5kdc[26854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492807, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.103.65@KRBTEST.COM
I20260812 00:00:07.476732 27691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:07.467657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47942 (local address 127.25.103.65:43823)
0812 00:00:07.467719 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:07.467722 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:07.467773 (+ 51us) server_negotiation.cc:407] Connection header received
0812 00:00:07.467858 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:07.467859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:07.467870 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:07.467928 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:07.468619 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:07.469128 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:07.469869 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:07.470117 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:07.470181 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:07.473328 (+ 3147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:07.473331 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:07.473331 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:07.473343 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:07.475372 (+ 2029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:07.475890 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:07.475891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:07.475892 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:07.475957 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:07.476136 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:07.476137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:07.476137 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:07.476254 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:07.476343 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:07.476529 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 00:00:07.476630 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
Aug 12 00:00:07 dist-test-slave-vpvm krb5kdc[26854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:00:07 dist-test-slave-vpvm krb5kdc[26854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.65@KRBTEST.COM
I20260812 00:00:07.507803 27691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:07.498193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47950 (local address 127.25.103.65:43823)
0812 00:00:07.498280 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:07.498283 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:07.498295 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:00:07.498404 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:07.498406 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:07.498418 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:07.498473 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:07.499397 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:07.499965 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:07.500859 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:07.501157 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:07.501459 (+ 302us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:07.504794 (+ 3335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:07.504796 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:07.504796 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:07.504805 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:07.506596 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:07.507048 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:07.507049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:07.507050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:07.507111 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:07.507282 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:07.507283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:07.507283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:07.507401 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:07.507494 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:07.507613 (+ 119us) server_negotiation.cc:299] Negotiation successful
0812 00:00:07.507701 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260812 00:00:07.508723 27102 tablet_service.cc:2908] Rejecting scan request for tablet e1eb3efafb924641a49018119489510d: Uninitialized: clean time has not yet been initialized
I20260812 00:00:07.510138 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 27020
I20260812 00:00:07.545409 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 27250
I20260812 00:00:07.597447 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 27465
I20260812 00:00:07.609840 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 26870
2026-08-12T00:00:07Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2823 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:00:07 dist-test-slave-vpvm krb5kdc[27730](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:00:07 dist-test-slave-vpvm krb5kdc[27730](info): set up 2 sockets
Aug 12 00:00:07 dist-test-slave-vpvm krb5kdc[27730](info): commencing operation
krb5kdc: starting...
W20260812 00:00:08.851051 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:00:08 dist-test-slave-vpvm krb5kdc[27730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:00:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:00:08.998332 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:36929
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:36929
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:09.097918 27748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:09.098219 27748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:09.098255 27748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:09.099578 27748 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:09.099625 27748 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 00:00:09.099643 27748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:09.099660 27748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:09.099677 27748 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:09.099694 27748 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:00:09.101600 27748 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:36929
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:36929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:09.101925 27748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:09.102226 27748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:09.107931 27762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:09.107931 27758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:09.108036 27757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:09.108264 27748 server_base.cc:1034] running on GCE node
I20260812 00:00:09.108539 27748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:09.108877 27748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:09.110041 27748 hybrid_clock.cc:648] HybridClock initialized: now 1786492809110010 us; error 47 us; skew 500 ppm
Aug 12 00:00:09 dist-test-slave-vpvm krb5kdc[27730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492809, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:09.112968 27748 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:00:09.113462 27748 webserver.cc:460] Webserver started at http://127.25.103.126:46633/ using document root <none> and password file <none>
I20260812 00:00:09.113760 27748 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:09.113812 27748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:09.114075 27748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:09.115310 27748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "03bae27f738e44ec8c2c86088d294593"
format_stamp: "Formatted at 2026-08-12 00:00:09 on dist-test-slave-vpvm"
server_key: "b91edde243a740cae5c2db811f0ac9d4"
server_key_iv: "46372c430c525d815ca359dd92f008d1"
server_key_version: "encryptionkey@0"
I20260812 00:00:09.115734 27748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "03bae27f738e44ec8c2c86088d294593"
format_stamp: "Formatted at 2026-08-12 00:00:09 on dist-test-slave-vpvm"
server_key: "b91edde243a740cae5c2db811f0ac9d4"
server_key_iv: "46372c430c525d815ca359dd92f008d1"
server_key_version: "encryptionkey@0"
I20260812 00:00:09.117570 27748 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260812 00:00:09.118863 27784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:09.119174 27748 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:09.119306 27748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "03bae27f738e44ec8c2c86088d294593"
format_stamp: "Formatted at 2026-08-12 00:00:09 on dist-test-slave-vpvm"
server_key: "b91edde243a740cae5c2db811f0ac9d4"
server_key_iv: "46372c430c525d815ca359dd92f008d1"
server_key_version: "encryptionkey@0"
I20260812 00:00:09.119423 27748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:09.132654 27748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:09.135169 27748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:09.135330 27748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:09.141382 27748 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:36929
I20260812 00:00:09.141487 27888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:36929 every 8 connection(s)
I20260812 00:00:09.141851 27748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:09.142905 27889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:09.145499 27889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593: Bootstrap starting.
I20260812 00:00:09.146304 27889 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:09.146651 27889 log.cc:824] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:09.147023 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 27748
I20260812 00:00:09.147109 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:00:09.147253 26013 external_mini_cluster.cc:1428] Setting key 9334f7c8698d6ae0cfe8f1ab3520e3fe
I20260812 00:00:09.147574 27889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593: No bootstrap required, opened a new log
I20260812 00:00:09.150494 27889 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03bae27f738e44ec8c2c86088d294593" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36929 } }
I20260812 00:00:09.150663 27889 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:09.150686 27889 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03bae27f738e44ec8c2c86088d294593, State: Initialized, Role: FOLLOWER
I20260812 00:00:09.150810 27889 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03bae27f738e44ec8c2c86088d294593" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36929 } }
I20260812 00:00:09.150888 27889 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:09.150918 27889 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:09.150995 27889 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:09.151679 27889 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03bae27f738e44ec8c2c86088d294593" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36929 } }
I20260812 00:00:09.151796 27889 leader_election.cc:302] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03bae27f738e44ec8c2c86088d294593; no voters:
I20260812 00:00:09.151989 27889 leader_election.cc:288] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:00:09.152042 27896 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:09.152262 27896 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593 [term 1 LEADER]: Becoming Leader. State: Replica: 03bae27f738e44ec8c2c86088d294593, State: Running, Role: LEADER
I20260812 00:00:09.152266 27889 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:09.152501 27896 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03bae27f738e44ec8c2c86088d294593" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36929 } }
I20260812 00:00:09.152921 27903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03bae27f738e44ec8c2c86088d294593. Latest consensus state: current_term: 1 leader_uuid: "03bae27f738e44ec8c2c86088d294593" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03bae27f738e44ec8c2c86088d294593" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36929 } } }
I20260812 00:00:09.153003 27903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593 [sys.catalog]: This master's current role is: LEADER
Aug 12 00:00:09 dist-test-slave-vpvm krb5kdc[27730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:09.155212 27899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03bae27f738e44ec8c2c86088d294593" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03bae27f738e44ec8c2c86088d294593" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36929 } } }
I20260812 00:00:09.155783 27899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593 [sys.catalog]: This master's current role is: LEADER
W20260812 00:00:09.155728 27920 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:00:09.155900 27920 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:00:09.155979 27921 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:09.156140 27921 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:00:09.158690 27895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.147873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34442 (local address 127.25.103.126:36929)
0812 00:00:09.148092 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:09.148101 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:09.148127 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:00:09.148952 (+ 825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:09.148961 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:09.149025 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:09.149168 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:09.149842 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.150888 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.151661 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.152262 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.152922 (+ 660us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.155159 (+ 2237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:09.155164 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:09.155165 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:09.155178 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:09.156883 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:09.157246 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:09.157249 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:09.157250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:09.157342 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:09.157524 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:09.157525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:09.157526 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:09.157809 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:09.158012 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:09.158314 (+ 302us) server_negotiation.cc:299] Negotiation successful
0812 00:00:09.158466 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":116,"threads_started":1}
I20260812 00:00:09.158690 27921 catalog_manager.cc:1347] Generated new cluster ID: 2ea380bb2cc644e2b462fd92072f47a0
I20260812 00:00:09.158877 27921 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:00:09.167506 27921 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:00:09.168171 27921 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:09.173133 27921 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593: Generated new TSK 0
I20260812 00:00:09.173358 27921 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
I20260812 00:00:09.214386 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:36929
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:09.316206 27929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:09.316494 27929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:09.316529 27929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:09.317930 27929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:09.318008 27929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:09.318030 27929 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:00:09.318050 27929 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:00:09.319783 27929 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.103.126:36929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:09.320062 27929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:09.320284 27929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:09.326264 27943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:09.326303 27939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:09.326256 27937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:09.326859 27929 server_base.cc:1034] running on GCE node
I20260812 00:00:09.327126 27929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:09.327390 27929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:09.328574 27929 hybrid_clock.cc:648] HybridClock initialized: now 1786492809328558 us; error 34 us; skew 500 ppm
Aug 12 00:00:09 dist-test-slave-vpvm krb5kdc[27730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492809, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:09.331990 27929 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:00:09.332464 27929 webserver.cc:460] Webserver started at http://127.25.103.65:35729/ using document root <none> and password file <none>
I20260812 00:00:09.332666 27929 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:09.332731 27929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:09.332863 27929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:09.334040 27929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "884b9384981b4b159ffad69cb58cfc9e"
format_stamp: "Formatted at 2026-08-12 00:00:09 on dist-test-slave-vpvm"
server_key: "3546d7d94ccb7d43737a0a67606c74e1"
server_key_iv: "b8918c94159b582b06b703090fde0052"
server_key_version: "encryptionkey@0"
I20260812 00:00:09.334446 27929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "884b9384981b4b159ffad69cb58cfc9e"
format_stamp: "Formatted at 2026-08-12 00:00:09 on dist-test-slave-vpvm"
server_key: "3546d7d94ccb7d43737a0a67606c74e1"
server_key_iv: "b8918c94159b582b06b703090fde0052"
server_key_version: "encryptionkey@0"
I20260812 00:00:09.336483 27929 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260812 00:00:09.337666 27956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:09.338078 27929 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:00:09.338222 27929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "884b9384981b4b159ffad69cb58cfc9e"
format_stamp: "Formatted at 2026-08-12 00:00:09 on dist-test-slave-vpvm"
server_key: "3546d7d94ccb7d43737a0a67606c74e1"
server_key_iv: "b8918c94159b582b06b703090fde0052"
server_key_version: "encryptionkey@0"
I20260812 00:00:09.338328 27929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:09.346495 27929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:09.349546 27929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:09.349696 27929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:09.350365 27929 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:09.350407 27929 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:09.350431 27929 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:09.350448 27929 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:09.359949 27929 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:46469
I20260812 00:00:09.360213 28151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:46469 every 8 connection(s)
I20260812 00:00:09.360576 27929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:00:09 dist-test-slave-vpvm krb5kdc[27730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492809, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:09.363935 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 27929
I20260812 00:00:09.364084 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:00:09.364280 26013 external_mini_cluster.cc:1428] Setting key 1f6cfdf366e157695950204d4a465ecb
I20260812 00:00:09.367394 27895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.350950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:49273 (local address 127.25.103.126:36929)
0812 00:00:09.351022 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:09.351031 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:09.351213 (+ 182us) server_negotiation.cc:407] Connection header received
0812 00:00:09.351782 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:09.351784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:09.351799 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:09.351891 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:09.352859 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.353679 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.356275 (+ 2596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.356737 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.356837 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.362156 (+ 5319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:09.362159 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:09.362159 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:09.362171 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:09.365009 (+ 2838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:09.365826 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:09.365828 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:09.365829 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:09.366010 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:09.366510 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:09.366512 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:09.366513 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:09.366683 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:09.366755 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:09.367168 (+ 413us) server_negotiation.cc:299] Negotiation successful
0812 00:00:09.367285 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:00:09.367516 27969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.350897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:36929 (local address 127.25.103.65:49273)
0812 00:00:09.351075 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:09.351119 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:09.351666 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:09.351973 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:09.351978 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:09.352373 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:09.352714 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:09.352722 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.353782 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.353783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:09.356011 (+ 2228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:09.356031 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.356883 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.356884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:09.358303 (+ 1419us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.359341 (+ 1038us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:09.359352 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:09.361922 (+ 2570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:09.365123 (+ 3201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:09.365144 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:09.365148 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:09.365579 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:09.366178 (+ 599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:09.366179 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:09.366180 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:09.366364 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:09.366756 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:09.366763 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:09.366995 (+ 232us) client_negotiation.cc:769] Sending connection context
0812 00:00:09.367118 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 00:00:09.367294 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":100,"threads_started":1}
I20260812 00:00:09.368261 28153 heartbeater.cc:347] Connected to a master server at 127.25.103.126:36929
I20260812 00:00:09.368363 28153 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:09.368637 28153 heartbeater.cc:511] Master 127.25.103.126:36929 requested a full tablet report, sending...
I20260812 00:00:09.369230 27811 ts_manager.cc:194] Registered new tserver with Master: 884b9384981b4b159ffad69cb58cfc9e (127.25.103.65:46469)
I20260812 00:00:09.370065 27811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:49273
WARNING: no policy specified for kudu/127.25.103.66@KRBTEST.COM; defaulting to no policy
I20260812 00:00:09.378934 27895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.369592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:40665 (local address 127.25.103.126:36929)
0812 00:00:09.369636 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:09.369638 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:09.370327 (+ 689us) server_negotiation.cc:407] Connection header received
0812 00:00:09.370391 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:09.370392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:09.370403 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:09.370452 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:09.370832 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.371371 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.372096 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.372292 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.372352 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.373358 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:09.373360 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:09.373360 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:09.373369 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:09.376130 (+ 2761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:09.376845 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:09.376847 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:09.376848 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:09.376929 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:09.377135 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:09.377136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:09.377137 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:09.377473 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:09.378116 (+ 643us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:09.378712 (+ 596us) server_negotiation.cc:299] Negotiation successful
0812 00:00:09.378825 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:00:09.378954 28165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.369526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:36929 (local address 127.25.103.65:40665)
0812 00:00:09.370258 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:09.370272 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:09.370342 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:09.370463 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:09.370464 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:09.370688 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:09.370750 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:09.370753 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.371490 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.371491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:09.372010 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:09.372012 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.372361 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.372362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:09.372444 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.372914 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:09.372919 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:09.373258 (+ 339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:09.376292 (+ 3034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:09.376294 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:09.376295 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:09.376691 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:09.377008 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:09.377009 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:09.377010 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:09.377077 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:09.378130 (+ 1053us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:09.378132 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:09.378512 (+ 380us) client_negotiation.cc:769] Sending connection context
0812 00:00:09.378642 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 00:00:09.378818 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":698,"thread_start_us":93,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
I20260812 00:00:09.402907 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:36929
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:09.503473 28167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:09.503762 28167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:09.503806 28167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:09.505261 28167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:09.505303 28167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:09.505335 28167 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:00:09.505363 28167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:00:09.507031 28167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.103.126:36929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:09.507509 28167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:09.507846 28167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:09.513581 28178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:09.513566 28175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:09.513823 28167 server_base.cc:1034] running on GCE node
W20260812 00:00:09.513566 28174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:09.514279 28167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:09.514605 28167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:09.515822 28167 hybrid_clock.cc:648] HybridClock initialized: now 1786492809515783 us; error 59 us; skew 500 ppm
Aug 12 00:00:09 dist-test-slave-vpvm krb5kdc[27730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492809, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:09.519033 28167 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:00:09.519857 28167 webserver.cc:460] Webserver started at http://127.25.103.66:39847/ using document root <none> and password file <none>
I20260812 00:00:09.520304 28167 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:09.520406 28167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:09.520556 28167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:09.521909 28167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "a4bef64c972a493999afc673edbbfc94"
format_stamp: "Formatted at 2026-08-12 00:00:09 on dist-test-slave-vpvm"
server_key: "6251e09df273e72e77a67a3f8008ca87"
server_key_iv: "fe09e1a40c5eba7f591ab6edecbf5775"
server_key_version: "encryptionkey@0"
I20260812 00:00:09.522373 28167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "a4bef64c972a493999afc673edbbfc94"
format_stamp: "Formatted at 2026-08-12 00:00:09 on dist-test-slave-vpvm"
server_key: "6251e09df273e72e77a67a3f8008ca87"
server_key_iv: "fe09e1a40c5eba7f591ab6edecbf5775"
server_key_version: "encryptionkey@0"
I20260812 00:00:09.524242 28167 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260812 00:00:09.525192 28187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:09.525394 28167 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:09.525511 28167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "a4bef64c972a493999afc673edbbfc94"
format_stamp: "Formatted at 2026-08-12 00:00:09 on dist-test-slave-vpvm"
server_key: "6251e09df273e72e77a67a3f8008ca87"
server_key_iv: "fe09e1a40c5eba7f591ab6edecbf5775"
server_key_version: "encryptionkey@0"
I20260812 00:00:09.525591 28167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:09.538681 28167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:09.540942 28167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:09.541095 28167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:09.541728 28167 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:09.541776 28167 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:09.541808 28167 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:09.541826 28167 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:00:09 dist-test-slave-vpvm krb5kdc[27730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492809, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:09.550101 28167 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:41249
I20260812 00:00:09.550182 28354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:41249 every 8 connection(s)
I20260812 00:00:09.550539 28167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:00:09.551236 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 28167
I20260812 00:00:09.551337 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:00:09.551457 27895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.542216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:55455 (local address 127.25.103.126:36929)
0812 00:00:09.542285 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:09.542288 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:09.542494 (+ 206us) server_negotiation.cc:407] Connection header received
0812 00:00:09.543102 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:09.543106 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:09.543151 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:09.543300 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:09.544105 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.544662 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.545721 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.545921 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.546021 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.548497 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:09.548498 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:09.548498 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:09.548507 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:09.549820 (+ 1313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:09.550336 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:09.550338 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:09.550338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:09.550389 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:09.550704 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:09.550705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:09.550705 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:09.550851 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:09.550919 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:09.551248 (+ 329us) server_negotiation.cc:299] Negotiation successful
0812 00:00:09.551346 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:00:09.551529 26013 external_mini_cluster.cc:1428] Setting key 487bcab7d859cd045d8c5015aa22e0ad
I20260812 00:00:09.551568 28201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.542177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:36929 (local address 127.25.103.66:55455)
0812 00:00:09.542342 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:09.542384 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:09.542906 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:09.543384 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:09.543390 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:09.543712 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:09.543983 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:09.543989 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.544764 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.544765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:09.545627 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:09.545630 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.546034 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.546035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:09.546180 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.546796 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:09.546806 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:09.548373 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:09.549931 (+ 1558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:09.549936 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:09.549938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:09.550250 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:09.550462 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:09.550463 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:09.550463 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:09.550613 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:09.550950 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:09.550955 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:09.551093 (+ 138us) client_negotiation.cc:769] Sending connection context
0812 00:00:09.551179 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 00:00:09.551321 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":92,"threads_started":1}
I20260812 00:00:09.552179 28355 heartbeater.cc:347] Connected to a master server at 127.25.103.126:36929
I20260812 00:00:09.552261 28355 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:09.552413 28355 heartbeater.cc:511] Master 127.25.103.126:36929 requested a full tablet report, sending...
I20260812 00:00:09.552750 27812 ts_manager.cc:194] Registered new tserver with Master: a4bef64c972a493999afc673edbbfc94 (127.25.103.66:41249)
I20260812 00:00:09.553637 27812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:55455
I20260812 00:00:09.561440 27895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.553409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:39407 (local address 127.25.103.126:36929)
0812 00:00:09.553451 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:09.553453 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:09.554202 (+ 749us) server_negotiation.cc:407] Connection header received
0812 00:00:09.554338 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:09.554339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:09.554352 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:09.554379 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:09.554843 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.555373 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.556258 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.556472 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.556534 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.558115 (+ 1581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:09.558116 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:09.558117 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:09.558125 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:09.559849 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:09.560330 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:09.560332 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:09.560332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:09.560493 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:09.560744 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:09.560745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:09.560745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:09.560936 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:09.560995 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:09.561258 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 00:00:09.561353 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:00:09.561741 28362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.553328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:36929 (local address 127.25.103.66:39407)
0812 00:00:09.554126 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:09.554139 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:09.554265 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:09.554438 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:09.554439 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:09.554672 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:09.554736 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:09.554738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.555468 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.555469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:09.556160 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:09.556164 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.556638 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.556640 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:09.556777 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.557413 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:09.557420 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:09.557994 (+ 574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:09.559955 (+ 1961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:09.559957 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:09.559957 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:09.560211 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:09.560587 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:09.560588 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:09.560588 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:09.560672 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:09.561008 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:09.561009 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:09.561091 (+ 82us) client_negotiation.cc:769] Sending connection context
0812 00:00:09.561175 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 00:00:09.561396 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":769,"thread_start_us":183,"threads_started":1}
WARNING: no policy specified for kudu/127.25.103.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
I20260812 00:00:09.583643 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:36929
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:09.681727 28367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:09.682083 28367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:09.682122 28367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:09.683629 28367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:09.683674 28367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:09.683702 28367 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:00:09.683720 28367 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:00:09.685400 28367 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.103.126:36929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:09.685681 28367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:09.686088 28367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:09.692369 28375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:09.692368 28378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:09.692368 28381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:09.692826 28367 server_base.cc:1034] running on GCE node
I20260812 00:00:09.693081 28367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:09.693378 28367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:09.694566 28367 hybrid_clock.cc:648] HybridClock initialized: now 1786492809694545 us; error 37 us; skew 500 ppm
Aug 12 00:00:09 dist-test-slave-vpvm krb5kdc[27730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492809, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:09.697760 28367 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:00:09.698426 28367 webserver.cc:460] Webserver started at http://127.25.103.67:36987/ using document root <none> and password file <none>
I20260812 00:00:09.698684 28367 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:09.698734 28367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:09.698853 28367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:09.700105 28367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "407fab3e61494759ad8575f4aa3b937d"
format_stamp: "Formatted at 2026-08-12 00:00:09 on dist-test-slave-vpvm"
server_key: "bd8651dbaa697e1d6866260e07de5a59"
server_key_iv: "63101da4f90922249a4c5ecfcf6a3718"
server_key_version: "encryptionkey@0"
I20260812 00:00:09.700506 28367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "407fab3e61494759ad8575f4aa3b937d"
format_stamp: "Formatted at 2026-08-12 00:00:09 on dist-test-slave-vpvm"
server_key: "bd8651dbaa697e1d6866260e07de5a59"
server_key_iv: "63101da4f90922249a4c5ecfcf6a3718"
server_key_version: "encryptionkey@0"
I20260812 00:00:09.702081 28367 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:00:09.703053 28391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:09.703282 28367 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:09.703550 28367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "407fab3e61494759ad8575f4aa3b937d"
format_stamp: "Formatted at 2026-08-12 00:00:09 on dist-test-slave-vpvm"
server_key: "bd8651dbaa697e1d6866260e07de5a59"
server_key_iv: "63101da4f90922249a4c5ecfcf6a3718"
server_key_version: "encryptionkey@0"
I20260812 00:00:09.703711 28367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:09.716140 28367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:09.718425 28367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:09.718555 28367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:09.719112 28367 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:09.719156 28367 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:09.719182 28367 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:09.719193 28367 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:09.726176 28367 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:43721
I20260812 00:00:09.726261 28575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:43721 every 8 connection(s)
Aug 12 00:00:09 dist-test-slave-vpvm krb5kdc[27730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492809, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:09.726639 28367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:00:09.730274 27895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.719723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:36045 (local address 127.25.103.126:36929)
0812 00:00:09.719783 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:09.719785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:09.720030 (+ 245us) server_negotiation.cc:407] Connection header received
0812 00:00:09.720708 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:09.720710 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:09.720725 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:09.720790 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:09.721737 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.722568 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.723794 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.724096 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.724168 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.727132 (+ 2964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:09.727134 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:09.727134 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:09.727144 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:09.728790 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:09.729257 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:09.729259 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:09.729259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:09.729320 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:09.729566 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:09.729567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:09.729567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:09.729701 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:09.729761 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:09.730081 (+ 320us) server_negotiation.cc:299] Negotiation successful
0812 00:00:09.730175 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:00:09.730471 28404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.719703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:36929 (local address 127.25.103.67:36045)
0812 00:00:09.719900 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:09.719939 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:09.720569 (+ 630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:09.720896 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:09.720901 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:09.721303 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:09.721619 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:09.721626 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.722679 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.722680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:09.723688 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:09.723691 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.724191 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.724192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:09.724353 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.724980 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:09.724991 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:09.727019 (+ 2028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:09.728904 (+ 1885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:09.728913 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:09.728916 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:09.729173 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:09.729380 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:09.729381 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:09.729381 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:09.729505 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:09.729761 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:09.729767 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:09.729921 (+ 154us) client_negotiation.cc:769] Sending connection context
0812 00:00:09.730047 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 00:00:09.730234 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":94,"threads_started":1}
I20260812 00:00:09.730970 28577 heartbeater.cc:347] Connected to a master server at 127.25.103.126:36929
I20260812 00:00:09.731079 28577 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:09.731165 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 28367
I20260812 00:00:09.731248 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:00:09.731289 28577 heartbeater.cc:511] Master 127.25.103.126:36929 requested a full tablet report, sending...
I20260812 00:00:09.731424 26013 external_mini_cluster.cc:1428] Setting key 97ac7bf180435437424c0c242df47073
I20260812 00:00:09.731784 27812 ts_manager.cc:194] Registered new tserver with Master: 407fab3e61494759ad8575f4aa3b937d (127.25.103.67:43721)
I20260812 00:00:09.732242 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:00:09.732270 27812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:36045
I20260812 00:00:09.741545 27895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.734036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:42675 (local address 127.25.103.126:36929)
0812 00:00:09.734159 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:09.734162 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:09.734179 (+ 17us) server_negotiation.cc:407] Connection header received
0812 00:00:09.734216 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:09.734217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:09.734232 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:09.734325 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:09.734791 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.735578 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.736460 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.736674 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.736765 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.738096 (+ 1331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:09.738097 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:09.738098 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:09.738105 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:09.740098 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:09.740570 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:09.740571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:09.740572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:09.740651 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:09.740816 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:09.740869 (+ 53us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:09.740870 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:09.741071 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:09.741171 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:09.741339 (+ 168us) server_negotiation.cc:299] Negotiation successful
0812 00:00:09.741469 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 00:00:09.741700 28586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.732149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:36929 (local address 127.25.103.67:42675)
0812 00:00:09.732297 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:09.732309 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:09.732358 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:09.734372 (+ 2014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:09.734373 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:09.734618 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:09.734696 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:09.734698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.735697 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.735698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:09.736335 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:09.736338 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.736784 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.736785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:09.736887 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.737485 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:09.737491 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:09.737983 (+ 492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:09.740230 (+ 2247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:09.740231 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:09.740232 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:09.740466 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:09.740711 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:09.740712 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:09.740712 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:09.740769 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:09.741158 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:09.741159 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:09.741221 (+ 62us) client_negotiation.cc:769] Sending connection context
0812 00:00:09.741298 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:00:09.741525 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":88,"threads_started":1}
Aug 12 00:00:09 dist-test-slave-vpvm krb5kdc[27730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492809, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:00:09 dist-test-slave-vpvm krb5kdc[27730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492809, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:09.762720 27895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.753485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34454 (local address 127.25.103.126:36929)
0812 00:00:09.753538 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:09.753540 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:09.753549 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:09.753577 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:09.753578 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:09.753588 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:09.753661 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:09.754439 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.755100 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.756097 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.756326 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.756392 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.759349 (+ 2957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:09.759351 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:09.759351 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:09.759360 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:09.760956 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:09.761407 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:09.761408 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:09.761409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:09.761470 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:09.761737 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:09.761739 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:09.761740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:09.762138 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:09.762248 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:09.762535 (+ 287us) server_negotiation.cc:299] Negotiation successful
0812 00:00:09.762621 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:00:09.765445 27812 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34454:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:00:09.767877 27812 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:00:09.775902 28602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.771143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:46469 (local address 127.0.0.1:39040)
0812 00:00:09.771354 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:09.771399 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:09.771477 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:09.772196 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:09.772197 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:09.772199 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:09.772262 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:09.772264 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.773288 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.773290 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:09.774613 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:09.774616 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.775547 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.775548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:09.775644 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.775662 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 00:00:09.775737 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 00:00:09.775776 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"spinlock_wait_cycles":768,"thread_start_us":95,"threads_started":1}
I20260812 00:00:09.775931 28606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.771553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39040 (local address 127.25.103.65:46469)
0812 00:00:09.772029 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:09.772033 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:09.772044 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:00:09.772084 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:09.772086 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:09.772101 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:09.772332 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:09.772387 (+ 55us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.773175 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.774700 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.775416 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.775528 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.775604 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:09.775768 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 00:00:09.775819 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":90,"threads_started":1}
I20260812 00:00:09.775902 28603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.771143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:41249 (local address 127.0.0.1:46162)
0812 00:00:09.771428 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:09.771436 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:09.771494 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:09.772003 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:09.772007 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:09.772011 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:09.772118 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:09.772120 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.773547 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.773548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:09.774833 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:09.774837 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.775572 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.775572 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:09.775644 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.775662 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 00:00:09.775712 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 00:00:09.775776 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"mutex_wait_us":54,"thread_start_us":85,"threads_started":1}
I20260812 00:00:09.776219 28605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.771256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46162 (local address 127.25.103.66:41249)
0812 00:00:09.771650 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:09.771655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:09.771666 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:00:09.771711 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:09.771714 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:09.771730 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:09.771803 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:09.772230 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.773434 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.774951 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.775476 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.775958 (+ 482us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.776033 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:09.776062 (+ 29us) server_negotiation.cc:299] Negotiation successful
0812 00:00:09.776108 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":165,"threads_started":1}
I20260812 00:00:09.776357 28604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.771230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:43721 (local address 127.0.0.1:58790)
0812 00:00:09.771623 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:09.771631 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:09.771668 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:09.772236 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:09.772237 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:09.772238 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:09.772269 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:09.772270 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.773547 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.773548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:09.774835 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:09.774837 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.775836 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.775837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:09.775908 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.775913 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:00:09.775962 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 00:00:09.776165 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"mutex_wait_us":71,"thread_start_us":182,"threads_started":1}
I20260812 00:00:09.776763 28607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:09.771572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58790 (local address 127.25.103.67:43721)
0812 00:00:09.772034 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:09.772040 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:09.772054 (+ 14us) server_negotiation.cc:407] Connection header received
0812 00:00:09.772097 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:09.772099 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:09.772115 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:09.772235 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:09.772322 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.773460 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.774935 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:09.775680 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:09.775745 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:09.775797 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:09.776610 (+ 813us) server_negotiation.cc:299] Negotiation successful
0812 00:00:09.776660 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":84,"threads_started":1}
I20260812 00:00:09.776968 28039 tablet_service.cc:1467] Processing CreateTablet for tablet bb064013825e4046b40f4f792a1e1515 (DEFAULT_TABLE table=test-table [id=f2018f79eb794ec891414d0ed31e946e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:09.776986 28260 tablet_service.cc:1467] Processing CreateTablet for tablet bb064013825e4046b40f4f792a1e1515 (DEFAULT_TABLE table=test-table [id=f2018f79eb794ec891414d0ed31e946e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:09.777398 28260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb064013825e4046b40f4f792a1e1515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:09.777667 28039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb064013825e4046b40f4f792a1e1515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:09.777801 28471 tablet_service.cc:1467] Processing CreateTablet for tablet bb064013825e4046b40f4f792a1e1515 (DEFAULT_TABLE table=test-table [id=f2018f79eb794ec891414d0ed31e946e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:09.778259 28471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb064013825e4046b40f4f792a1e1515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:09.782553 28610 tablet_bootstrap.cc:492] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d: Bootstrap starting.
I20260812 00:00:09.782991 28611 tablet_bootstrap.cc:492] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e: Bootstrap starting.
I20260812 00:00:09.783916 28610 tablet_bootstrap.cc:654] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:09.783916 28611 tablet_bootstrap.cc:654] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:09.784533 28610 log.cc:824] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:09.784533 28611 log.cc:824] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:09.785038 28609 tablet_bootstrap.cc:492] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94: Bootstrap starting.
I20260812 00:00:09.785492 28611 tablet_bootstrap.cc:492] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e: No bootstrap required, opened a new log
I20260812 00:00:09.785573 28611 ts_tablet_manager.cc:1397] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:00:09.785710 28610 tablet_bootstrap.cc:492] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d: No bootstrap required, opened a new log
I20260812 00:00:09.785797 28610 ts_tablet_manager.cc:1397] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:00:09.785806 28609 tablet_bootstrap.cc:654] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:09.786185 28609 log.cc:824] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:09.787117 28609 tablet_bootstrap.cc:492] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94: No bootstrap required, opened a new log
I20260812 00:00:09.787201 28609 ts_tablet_manager.cc:1397] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:00:09.787515 28611 raft_consensus.cc:348] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:09.787680 28611 raft_consensus.cc:374] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:09.787715 28611 raft_consensus.cc:729] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 884b9384981b4b159ffad69cb58cfc9e, State: Initialized, Role: FOLLOWER
I20260812 00:00:09.787850 28611 consensus_queue.cc:260] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:09.787907 28610 raft_consensus.cc:348] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:09.788089 28610 raft_consensus.cc:374] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:09.788134 28610 raft_consensus.cc:729] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 407fab3e61494759ad8575f4aa3b937d, State: Initialized, Role: FOLLOWER
I20260812 00:00:09.788156 28611 ts_tablet_manager.cc:1428] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:00:09.788300 28153 heartbeater.cc:503] Master 127.25.103.126:36929 was elected leader, sending a full tablet report...
I20260812 00:00:09.788282 28610 consensus_queue.cc:260] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:09.788630 28577 heartbeater.cc:503] Master 127.25.103.126:36929 was elected leader, sending a full tablet report...
I20260812 00:00:09.788566 28610 ts_tablet_manager.cc:1428] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:00:09.789634 28609 raft_consensus.cc:348] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:09.789808 28609 raft_consensus.cc:374] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:09.789835 28609 raft_consensus.cc:729] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4bef64c972a493999afc673edbbfc94, State: Initialized, Role: FOLLOWER
I20260812 00:00:09.789981 28609 consensus_queue.cc:260] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:09.790300 28609 ts_tablet_manager.cc:1428] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:00:09.790320 28355 heartbeater.cc:503] Master 127.25.103.126:36929 was elected leader, sending a full tablet report...
W20260812 00:00:09.801329 28356 tablet.cc:2369] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:00:09.861567 28155 tablet.cc:2369] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:00:09.977423 28578 tablet.cc:2369] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:00:10.012226 28624 raft_consensus.cc:482] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:00:10.012405 28624 raft_consensus.cc:504] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.012828 28624 leader_election.cc:288] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 884b9384981b4b159ffad69cb58cfc9e (127.25.103.65:46469), 407fab3e61494759ad8575f4aa3b937d (127.25.103.67:43721)
I20260812 00:00:10.017220 28201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.013043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:46469 (local address 127.25.103.66:49531)
0812 00:00:10.013133 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:10.013147 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:10.013202 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:10.013364 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:10.013365 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:10.013367 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:10.013446 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.013448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.014421 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.014422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.015924 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.015933 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.016837 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.016839 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.016981 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.016988 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 00:00:10.017072 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 00:00:10.017126 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66,"mutex_wait_us":96}
I20260812 00:00:10.017319 28606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.013178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:49531 (local address 127.25.103.65:46469)
0812 00:00:10.013235 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:10.013237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:10.013248 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:00:10.013279 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:10.013280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:10.013289 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:10.013344 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:10.013518 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.014313 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.016112 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.016707 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.016788 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.016797 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:10.017147 (+ 350us) server_negotiation.cc:299] Negotiation successful
0812 00:00:10.017234 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:00:10.017918 28625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.013074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:43721 (local address 127.25.103.66:44493)
0812 00:00:10.013292 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:10.013300 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:10.013348 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:10.013463 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:10.013464 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:10.013477 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:10.013546 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.013547 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.014421 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.014422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.015935 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.015937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.016837 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.016839 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.017681 (+ 842us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.017687 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:00:10.017763 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 00:00:10.017813 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":68,"thread_start_us":136,"threads_started":1}
I20260812 00:00:10.017831 28073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb064013825e4046b40f4f792a1e1515" candidate_uuid: "a4bef64c972a493999afc673edbbfc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884b9384981b4b159ffad69cb58cfc9e" is_pre_election: true
I20260812 00:00:10.017930 28607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.013171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:44493 (local address 127.25.103.67:43721)
0812 00:00:10.013238 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:10.013240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:10.013357 (+ 117us) server_negotiation.cc:407] Connection header received
0812 00:00:10.013389 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:10.013390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:10.013399 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:10.013447 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:10.013606 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.014327 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.016112 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.016686 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.016788 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.016797 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:10.017806 (+ 1009us) server_negotiation.cc:299] Negotiation successful
0812 00:00:10.017870 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 00:00:10.018085 28073 raft_consensus.cc:2454] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4bef64c972a493999afc673edbbfc94 in term 0.
I20260812 00:00:10.018270 28498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb064013825e4046b40f4f792a1e1515" candidate_uuid: "a4bef64c972a493999afc673edbbfc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "407fab3e61494759ad8575f4aa3b937d" is_pre_election: true
I20260812 00:00:10.018392 28192 leader_election.cc:302] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 884b9384981b4b159ffad69cb58cfc9e, a4bef64c972a493999afc673edbbfc94; no voters:
I20260812 00:00:10.018441 28498 raft_consensus.cc:2454] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4bef64c972a493999afc673edbbfc94 in term 0.
I20260812 00:00:10.018568 28624 raft_consensus.cc:2781] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:00:10.018622 28624 raft_consensus.cc:482] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:00:10.018646 28624 raft_consensus.cc:3037] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:10.019375 28624 raft_consensus.cc:504] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.019517 28624 leader_election.cc:288] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [CANDIDATE]: Term 1 election: Requested vote from peers 884b9384981b4b159ffad69cb58cfc9e (127.25.103.65:46469), 407fab3e61494759ad8575f4aa3b937d (127.25.103.67:43721)
I20260812 00:00:10.019709 28073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb064013825e4046b40f4f792a1e1515" candidate_uuid: "a4bef64c972a493999afc673edbbfc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884b9384981b4b159ffad69cb58cfc9e"
I20260812 00:00:10.019788 28073 raft_consensus.cc:3037] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:10.019769 28498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb064013825e4046b40f4f792a1e1515" candidate_uuid: "a4bef64c972a493999afc673edbbfc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "407fab3e61494759ad8575f4aa3b937d"
I20260812 00:00:10.019932 28498 raft_consensus.cc:3037] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:10.020516 28073 raft_consensus.cc:2454] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4bef64c972a493999afc673edbbfc94 in term 1.
I20260812 00:00:10.020782 28192 leader_election.cc:302] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 884b9384981b4b159ffad69cb58cfc9e, a4bef64c972a493999afc673edbbfc94; no voters:
I20260812 00:00:10.020956 28624 raft_consensus.cc:2781] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:10.021127 28624 raft_consensus.cc:686] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [term 1 LEADER]: Becoming Leader. State: Replica: a4bef64c972a493999afc673edbbfc94, State: Running, Role: LEADER
I20260812 00:00:10.021158 28498 raft_consensus.cc:2454] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4bef64c972a493999afc673edbbfc94 in term 1.
I20260812 00:00:10.021224 28624 consensus_queue.cc:237] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.022495 27812 catalog_manager.cc:5495] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4bef64c972a493999afc673edbbfc94 (127.25.103.66). New cstate: current_term: 1 leader_uuid: "a4bef64c972a493999afc673edbbfc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260812 00:00:10.067584 28605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.064657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46170 (local address 127.25.103.66:41249)
0812 00:00:10.064769 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:10.064771 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:10.064793 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:00:10.064912 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:10.064913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:10.064932 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:10.065009 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:10.065163 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.065649 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.066650 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.066848 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.066916 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.067150 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:10.067256 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:10.067319 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:10.067469 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 00:00:10.067495 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 00:00:10.069669 28498 raft_consensus.cc:1261] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d [term 1 FOLLOWER]: Refusing update from remote peer a4bef64c972a493999afc673edbbfc94: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:10.070335 28624 consensus_queue.cc:1035] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:10.071455 28073 raft_consensus.cc:1261] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e [term 1 FOLLOWER]: Refusing update from remote peer a4bef64c972a493999afc673edbbfc94: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:10.072021 28626 consensus_queue.cc:1035] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:10.073912 28633 mvcc.cc:205] Tried to move back new op lower bound from 7317474550041956352 to 7317474549847605248. Current Snapshot: MvccSnapshot[applied={T|T < 7317474550041956352}]
I20260812 00:00:10.079658 27811 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:10.079799 27811 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:10.080991 27811 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593: Sending DeleteTablet for 3 replicas of tablet bb064013825e4046b40f4f792a1e1515
I20260812 00:00:10.081694 28471 tablet_service.cc:1514] Processing DeleteTablet for tablet bb064013825e4046b40f4f792a1e1515 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:10 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:58790
I20260812 00:00:10.081704 28039 tablet_service.cc:1514] Processing DeleteTablet for tablet bb064013825e4046b40f4f792a1e1515 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:10 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:39040
I20260812 00:00:10.082050 28260 tablet_service.cc:1514] Processing DeleteTablet for tablet bb064013825e4046b40f4f792a1e1515 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:10 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:46162
I20260812 00:00:10.082441 28646 tablet_replica.cc:330] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d: stopping tablet replica
I20260812 00:00:10.082582 28643 tablet_replica.cc:330] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e: stopping tablet replica
I20260812 00:00:10.082645 28646 raft_consensus.cc:2229] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:10.082844 28646 raft_consensus.cc:2258] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:10.083174 28650 tablet_replica.cc:330] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94: stopping tablet replica
I20260812 00:00:10.083093 27811 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34454:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 00:00:10.083308 28650 raft_consensus.cc:2229] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [term 1 LEADER]: Raft consensus shutting down.
W20260812 00:00:10.083351 27811 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:00:10.083441 28650 raft_consensus.cc:2258] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:10.083613 28643 raft_consensus.cc:2229] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:10.083765 28643 raft_consensus.cc:2258] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:10.084070 28650 ts_tablet_manager.cc:1905] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:10.084292 28643 ts_tablet_manager.cc:1905] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:10.085669 28471 tablet_service.cc:1467] Processing CreateTablet for tablet 33e943909bcd48b082a438009ae03d11 (DEFAULT_TABLE table=test-table [id=a00e254a31444936b4d7c2f3233ddab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:10.085830 28471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33e943909bcd48b082a438009ae03d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:10.086504 28650 ts_tablet_manager.cc:1918] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:00:10.086504 28643 ts_tablet_manager.cc:1918] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:00:10.086613 28650 log.cc:1196] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/bb064013825e4046b40f4f792a1e1515
I20260812 00:00:10.086645 28643 log.cc:1196] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/wal/wals/bb064013825e4046b40f4f792a1e1515
I20260812 00:00:10.086949 28650 ts_tablet_manager.cc:1939] T bb064013825e4046b40f4f792a1e1515 P a4bef64c972a493999afc673edbbfc94: Deleting consensus metadata
I20260812 00:00:10.086949 28643 ts_tablet_manager.cc:1939] T bb064013825e4046b40f4f792a1e1515 P 884b9384981b4b159ffad69cb58cfc9e: Deleting consensus metadata
I20260812 00:00:10.087574 28610 tablet_bootstrap.cc:492] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d: Bootstrap starting.
I20260812 00:00:10.088107 28610 tablet_bootstrap.cc:654] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:10.088829 28610 tablet_bootstrap.cc:492] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d: No bootstrap required, opened a new log
I20260812 00:00:10.088871 28610 ts_tablet_manager.cc:1397] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:10.088744 27790 catalog_manager.cc:4841] TS a4bef64c972a493999afc673edbbfc94 (127.25.103.66:41249): tablet bb064013825e4046b40f4f792a1e1515 (table test-table [id=f2018f79eb794ec891414d0ed31e946e]) successfully deleted
I20260812 00:00:10.089020 28610 raft_consensus.cc:348] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.089076 28610 raft_consensus.cc:374] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:10.089088 28610 raft_consensus.cc:729] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 407fab3e61494759ad8575f4aa3b937d, State: Initialized, Role: FOLLOWER
I20260812 00:00:10.089123 28610 consensus_queue.cc:260] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.089179 28610 ts_tablet_manager.cc:1428] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:10.089249 27789 catalog_manager.cc:4841] TS 884b9384981b4b159ffad69cb58cfc9e (127.25.103.65:46469): tablet bb064013825e4046b40f4f792a1e1515 (table test-table [id=f2018f79eb794ec891414d0ed31e946e]) successfully deleted
I20260812 00:00:10.089562 28039 tablet_service.cc:1467] Processing CreateTablet for tablet 33e943909bcd48b082a438009ae03d11 (DEFAULT_TABLE table=test-table [id=a00e254a31444936b4d7c2f3233ddab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:10.089730 28039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33e943909bcd48b082a438009ae03d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:10.090075 28260 tablet_service.cc:1467] Processing CreateTablet for tablet 33e943909bcd48b082a438009ae03d11 (DEFAULT_TABLE table=test-table [id=a00e254a31444936b4d7c2f3233ddab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:10.090204 28260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33e943909bcd48b082a438009ae03d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:10.091223 28646 ts_tablet_manager.cc:1905] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:10.091444 28611 tablet_bootstrap.cc:492] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e: Bootstrap starting.
I20260812 00:00:10.091836 28609 tablet_bootstrap.cc:492] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94: Bootstrap starting.
I20260812 00:00:10.092026 28611 tablet_bootstrap.cc:654] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:10.092479 28609 tablet_bootstrap.cc:654] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:10.093453 28611 tablet_bootstrap.cc:492] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e: No bootstrap required, opened a new log
I20260812 00:00:10.093513 28611 ts_tablet_manager.cc:1397] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:10.093626 28609 tablet_bootstrap.cc:492] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94: No bootstrap required, opened a new log
I20260812 00:00:10.093664 28609 ts_tablet_manager.cc:1397] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:10.093655 28646 ts_tablet_manager.cc:1918] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:00:10.093755 28646 log.cc:1196] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/bb064013825e4046b40f4f792a1e1515
I20260812 00:00:10.093696 28611 raft_consensus.cc:348] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.093815 28611 raft_consensus.cc:374] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:10.093840 28611 raft_consensus.cc:729] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 884b9384981b4b159ffad69cb58cfc9e, State: Initialized, Role: FOLLOWER
I20260812 00:00:10.093840 28609 raft_consensus.cc:348] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.093916 28609 raft_consensus.cc:374] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:10.093897 28611 consensus_queue.cc:260] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.093940 28609 raft_consensus.cc:729] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4bef64c972a493999afc673edbbfc94, State: Initialized, Role: FOLLOWER
I20260812 00:00:10.094005 28609 consensus_queue.cc:260] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.094058 28611 ts_tablet_manager.cc:1428] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:10.094089 28609 ts_tablet_manager.cc:1428] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 00:00:10.094435 28646 ts_tablet_manager.cc:1939] T bb064013825e4046b40f4f792a1e1515 P 407fab3e61494759ad8575f4aa3b937d: Deleting consensus metadata
I20260812 00:00:10.095227 27788 catalog_manager.cc:4841] TS 407fab3e61494759ad8575f4aa3b937d (127.25.103.67:43721): tablet bb064013825e4046b40f4f792a1e1515 (table test-table [id=f2018f79eb794ec891414d0ed31e946e]) successfully deleted
I20260812 00:00:10.296990 28619 raft_consensus.cc:482] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:00:10.297132 28619 raft_consensus.cc:504] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.297503 28619 leader_election.cc:288] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4bef64c972a493999afc673edbbfc94 (127.25.103.66:41249), 407fab3e61494759ad8575f4aa3b937d (127.25.103.67:43721)
I20260812 00:00:10.301155 28607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.297852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:39087 (local address 127.25.103.67:43721)
0812 00:00:10.297910 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:10.297911 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:10.298555 (+ 644us) server_negotiation.cc:407] Connection header received
0812 00:00:10.298591 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:10.298592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:10.298602 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:10.298653 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:10.298818 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.299323 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.300404 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.300769 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.300832 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.300843 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:10.301024 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 00:00:10.301065 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:00:10.301163 28605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.297895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:33785 (local address 127.25.103.66:41249)
0812 00:00:10.297993 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:10.297995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:10.298187 (+ 192us) server_negotiation.cc:407] Connection header received
0812 00:00:10.298232 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:10.298234 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:10.298251 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:10.298322 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:10.298633 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.299236 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.300386 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.300781 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.300847 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.300859 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:10.301018 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 00:00:10.301072 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:00:10.301184 28658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.297852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:41249 (local address 127.25.103.65:33785)
0812 00:00:10.298034 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:10.298049 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:10.298144 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:10.298342 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:10.298343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:10.298346 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:10.298525 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.298533 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.299361 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.299362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.300293 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.300296 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.300888 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.300890 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.300956 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.300960 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:00:10.301007 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 00:00:10.301067 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":120,"threads_started":1}
I20260812 00:00:10.301211 28659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.298243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:43721 (local address 127.25.103.65:39087)
0812 00:00:10.298471 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:10.298482 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:10.298543 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:10.298660 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:10.298660 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:10.298662 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:10.298750 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.298753 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.299407 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.299408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.300300 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.300303 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.300867 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.300869 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.300951 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.300956 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:00:10.301003 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 00:00:10.301065 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":1,"thread_start_us":125,"threads_started":1}
I20260812 00:00:10.301470 28290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33e943909bcd48b082a438009ae03d11" candidate_uuid: "884b9384981b4b159ffad69cb58cfc9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bef64c972a493999afc673edbbfc94" is_pre_election: true
I20260812 00:00:10.301682 28290 raft_consensus.cc:2454] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 884b9384981b4b159ffad69cb58cfc9e in term 0.
I20260812 00:00:10.301647 28498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33e943909bcd48b082a438009ae03d11" candidate_uuid: "884b9384981b4b159ffad69cb58cfc9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "407fab3e61494759ad8575f4aa3b937d" is_pre_election: true
I20260812 00:00:10.301743 28498 raft_consensus.cc:2454] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 884b9384981b4b159ffad69cb58cfc9e in term 0.
I20260812 00:00:10.301924 27959 leader_election.cc:302] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 884b9384981b4b159ffad69cb58cfc9e, a4bef64c972a493999afc673edbbfc94; no voters:
I20260812 00:00:10.302178 28619 raft_consensus.cc:2781] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:00:10.302232 28619 raft_consensus.cc:482] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:00:10.302245 28619 raft_consensus.cc:3037] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:10.303313 28619 raft_consensus.cc:504] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.303489 28619 leader_election.cc:288] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [CANDIDATE]: Term 1 election: Requested vote from peers a4bef64c972a493999afc673edbbfc94 (127.25.103.66:41249), 407fab3e61494759ad8575f4aa3b937d (127.25.103.67:43721)
I20260812 00:00:10.303721 28498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33e943909bcd48b082a438009ae03d11" candidate_uuid: "884b9384981b4b159ffad69cb58cfc9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "407fab3e61494759ad8575f4aa3b937d"
I20260812 00:00:10.303743 28290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33e943909bcd48b082a438009ae03d11" candidate_uuid: "884b9384981b4b159ffad69cb58cfc9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bef64c972a493999afc673edbbfc94"
I20260812 00:00:10.303822 28290 raft_consensus.cc:3037] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:10.303822 28498 raft_consensus.cc:3037] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:10.304773 28498 raft_consensus.cc:2454] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 884b9384981b4b159ffad69cb58cfc9e in term 1.
I20260812 00:00:10.304788 28290 raft_consensus.cc:2454] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 884b9384981b4b159ffad69cb58cfc9e in term 1.
I20260812 00:00:10.305027 27959 leader_election.cc:302] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 884b9384981b4b159ffad69cb58cfc9e, a4bef64c972a493999afc673edbbfc94; no voters:
I20260812 00:00:10.305150 28619 raft_consensus.cc:2781] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:10.305538 28619 raft_consensus.cc:686] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [term 1 LEADER]: Becoming Leader. State: Replica: 884b9384981b4b159ffad69cb58cfc9e, State: Running, Role: LEADER
I20260812 00:00:10.305655 28619 consensus_queue.cc:237] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.306952 27811 catalog_manager.cc:5495] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 884b9384981b4b159ffad69cb58cfc9e (127.25.103.65). New cstate: current_term: 1 leader_uuid: "884b9384981b4b159ffad69cb58cfc9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } health_report { overall_health: UNKNOWN } } }
Aug 12 00:00:10 dist-test-slave-vpvm krb5kdc[27730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492809, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:10.348433 28669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.339081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:36929 (local address 127.0.0.1:34462)
0812 00:00:10.339457 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:10.339475 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:10.339574 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:10.339869 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:10.339871 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:10.340317 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:10.340395 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.340398 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.341324 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.341326 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.341904 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.341907 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.342439 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.342440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.342490 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.343068 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:10.343072 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:10.345049 (+ 1977us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:10.346978 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:10.346991 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:10.346994 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:10.347232 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:10.347631 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:10.347632 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:10.347632 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:10.347711 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:10.348106 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:10.348115 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:10.348170 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 00:00:10.348233 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:00:10.348347 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":166,"threads_started":1}
I20260812 00:00:10.348520 28670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.339286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34462 (local address 127.25.103.126:36929)
0812 00:00:10.339440 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:10.339442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:10.339651 (+ 209us) server_negotiation.cc:407] Connection header received
0812 00:00:10.339702 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:10.339703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:10.339720 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:10.339803 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:10.340534 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.341191 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.342081 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.342349 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.342407 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.345168 (+ 2761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:10.345170 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:10.345170 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:10.345179 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:10.346834 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:10.347374 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:10.347377 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:10.347377 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:10.347500 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:10.347815 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:10.347816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:10.347817 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:10.347978 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:10.348116 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:10.348310 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 00:00:10.348418 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":119,"thread_start_us":84,"threads_started":1}
I20260812 00:00:10.351174 27811 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:34462:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 00:00:10.351498 27811 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:00:10.353020 28260 tablet_service.cc:1467] Processing CreateTablet for tablet 280f7017da3b40eda9088636bc2d5545 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0bd393cc93f04106aba9137cd53f1b48]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:00:10.353134 28039 tablet_service.cc:1467] Processing CreateTablet for tablet 280f7017da3b40eda9088636bc2d5545 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0bd393cc93f04106aba9137cd53f1b48]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:00:10.353134 28471 tablet_service.cc:1467] Processing CreateTablet for tablet 280f7017da3b40eda9088636bc2d5545 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0bd393cc93f04106aba9137cd53f1b48]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:00:10.353298 28260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 280f7017da3b40eda9088636bc2d5545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:10.353327 28039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 280f7017da3b40eda9088636bc2d5545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:10.353339 28471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 280f7017da3b40eda9088636bc2d5545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:10.355052 28609 tablet_bootstrap.cc:492] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94: Bootstrap starting.
I20260812 00:00:10.355201 28611 tablet_bootstrap.cc:492] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e: Bootstrap starting.
I20260812 00:00:10.355463 28609 tablet_bootstrap.cc:654] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:10.355633 28611 tablet_bootstrap.cc:654] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:10.356027 28610 tablet_bootstrap.cc:492] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d: Bootstrap starting.
I20260812 00:00:10.356343 28609 tablet_bootstrap.cc:492] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94: No bootstrap required, opened a new log
I20260812 00:00:10.356441 28609 ts_tablet_manager.cc:1397] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 00:00:10.356451 28610 tablet_bootstrap.cc:654] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:10.356618 28611 tablet_bootstrap.cc:492] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e: No bootstrap required, opened a new log
I20260812 00:00:10.356617 28609 raft_consensus.cc:348] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.356696 28611 ts_tablet_manager.cc:1397] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:10.356715 28609 raft_consensus.cc:374] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:10.356738 28609 raft_consensus.cc:729] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4bef64c972a493999afc673edbbfc94, State: Initialized, Role: FOLLOWER
I20260812 00:00:10.356870 28611 raft_consensus.cc:348] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.356969 28611 raft_consensus.cc:374] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:10.356904 28609 consensus_queue.cc:260] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.356989 28611 raft_consensus.cc:729] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 884b9384981b4b159ffad69cb58cfc9e, State: Initialized, Role: FOLLOWER
I20260812 00:00:10.357033 28611 consensus_queue.cc:260] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.357059 28609 ts_tablet_manager.cc:1428] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 00:00:10.357121 28611 ts_tablet_manager.cc:1428] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:10.357085 28626 tablet_replica.cc:439] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } } }
I20260812 00:00:10.357180 28626 tablet_replica.cc:442] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:10.357280 28610 tablet_bootstrap.cc:492] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d: No bootstrap required, opened a new log
I20260812 00:00:10.357321 28610 ts_tablet_manager.cc:1397] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:10.357424 28619 tablet_replica.cc:439] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } } }
I20260812 00:00:10.357475 28610 raft_consensus.cc:348] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.357513 28619 tablet_replica.cc:442] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:10.357537 28610 raft_consensus.cc:374] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:10.357556 28610 raft_consensus.cc:729] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 407fab3e61494759ad8575f4aa3b937d, State: Initialized, Role: FOLLOWER
I20260812 00:00:10.357600 28610 consensus_queue.cc:260] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.357686 28610 ts_tablet_manager.cc:1428] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:00:10.357807 28620 tablet_replica.cc:439] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } } }
I20260812 00:00:10.357892 28620 tablet_replica.cc:442] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:10.681840 28620 raft_consensus.cc:482] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:00:10.682057 28620 raft_consensus.cc:504] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.682569 28620 leader_election.cc:288] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 884b9384981b4b159ffad69cb58cfc9e (127.25.103.65:46469), a4bef64c972a493999afc673edbbfc94 (127.25.103.66:41249)
I20260812 00:00:10.686342 28679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.682873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:57775 (local address 127.25.103.65:46469)
0812 00:00:10.683005 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:10.683008 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:10.683069 (+ 61us) server_negotiation.cc:407] Connection header received
0812 00:00:10.683146 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:10.683147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:10.683160 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:10.683229 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:10.683394 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.683935 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.685040 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.685740 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.685814 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.685825 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:10.686179 (+ 354us) server_negotiation.cc:299] Negotiation successful
0812 00:00:10.686250 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":63,"threads_started":1}
I20260812 00:00:10.686334 28605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.682945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:50169 (local address 127.25.103.66:41249)
0812 00:00:10.682996 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:10.682998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:10.683083 (+ 85us) server_negotiation.cc:407] Connection header received
0812 00:00:10.683178 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:10.683178 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:10.683187 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:10.683242 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:10.683398 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.683931 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.685410 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.685848 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.685991 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.686004 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:10.686206 (+ 202us) server_negotiation.cc:299] Negotiation successful
0812 00:00:10.686257 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:00:10.686414 28676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.682836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:41249 (local address 127.25.103.67:50169)
0812 00:00:10.682999 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:10.683009 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:10.683089 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:10.683252 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:10.683253 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:10.683255 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:10.683339 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.683341 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.684016 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.684016 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.685137 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.685146 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.686015 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.686016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.686108 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.686113 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:00:10.686184 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 00:00:10.686250 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":2,"thread_start_us":61,"threads_started":1}
I20260812 00:00:10.686458 28678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.682797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:46469 (local address 127.25.103.67:57775)
0812 00:00:10.682974 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:10.682988 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:10.683067 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:10.683241 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:10.683242 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:10.683245 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:10.683331 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.683334 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.684017 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.684018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.684887 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.684889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.685912 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.685914 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.686086 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.686093 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 00:00:10.686153 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 00:00:10.686235 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":5,"thread_start_us":85,"threads_started":1}
I20260812 00:00:10.686904 28073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "280f7017da3b40eda9088636bc2d5545" candidate_uuid: "407fab3e61494759ad8575f4aa3b937d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884b9384981b4b159ffad69cb58cfc9e" is_pre_election: true
I20260812 00:00:10.686930 28290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "280f7017da3b40eda9088636bc2d5545" candidate_uuid: "407fab3e61494759ad8575f4aa3b937d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bef64c972a493999afc673edbbfc94" is_pre_election: true
I20260812 00:00:10.687064 28073 raft_consensus.cc:2454] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 407fab3e61494759ad8575f4aa3b937d in term 0.
I20260812 00:00:10.687064 28290 raft_consensus.cc:2454] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 407fab3e61494759ad8575f4aa3b937d in term 0.
I20260812 00:00:10.687356 28395 leader_election.cc:302] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 407fab3e61494759ad8575f4aa3b937d, a4bef64c972a493999afc673edbbfc94; no voters:
I20260812 00:00:10.687564 28620 raft_consensus.cc:2781] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:00:10.687620 28620 raft_consensus.cc:482] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:00:10.687654 28620 raft_consensus.cc:3037] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:10.688491 28620 raft_consensus.cc:504] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.688663 28620 leader_election.cc:288] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [CANDIDATE]: Term 1 election: Requested vote from peers 884b9384981b4b159ffad69cb58cfc9e (127.25.103.65:46469), a4bef64c972a493999afc673edbbfc94 (127.25.103.66:41249)
I20260812 00:00:10.688896 28290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "280f7017da3b40eda9088636bc2d5545" candidate_uuid: "407fab3e61494759ad8575f4aa3b937d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bef64c972a493999afc673edbbfc94"
I20260812 00:00:10.688908 28073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "280f7017da3b40eda9088636bc2d5545" candidate_uuid: "407fab3e61494759ad8575f4aa3b937d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884b9384981b4b159ffad69cb58cfc9e"
I20260812 00:00:10.688984 28290 raft_consensus.cc:3037] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:10.688992 28073 raft_consensus.cc:3037] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:10.689664 28290 raft_consensus.cc:2454] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 407fab3e61494759ad8575f4aa3b937d in term 1.
I20260812 00:00:10.689909 28395 leader_election.cc:302] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 407fab3e61494759ad8575f4aa3b937d, a4bef64c972a493999afc673edbbfc94; no voters:
I20260812 00:00:10.690052 28073 raft_consensus.cc:2454] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 407fab3e61494759ad8575f4aa3b937d in term 1.
I20260812 00:00:10.690080 28620 raft_consensus.cc:2781] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:10.690198 28620 raft_consensus.cc:686] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [term 1 LEADER]: Becoming Leader. State: Replica: 407fab3e61494759ad8575f4aa3b937d, State: Running, Role: LEADER
I20260812 00:00:10.690280 28620 consensus_queue.cc:237] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } }
I20260812 00:00:10.690819 28680 tablet_replica.cc:439] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d: TxnStatusTablet state changed. Reason: New leader 407fab3e61494759ad8575f4aa3b937d. Latest consensus state: current_term: 1 leader_uuid: "407fab3e61494759ad8575f4aa3b937d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } } }
I20260812 00:00:10.690932 28680 tablet_replica.cc:442] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:00:10.691124 28682 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 00:00:10.691088 27811 catalog_manager.cc:5495] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d reported cstate change: term changed from 0 to 1, leader changed from <none> to 407fab3e61494759ad8575f4aa3b937d (127.25.103.67). New cstate: current_term: 1 leader_uuid: "407fab3e61494759ad8575f4aa3b937d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } health_report { overall_health: HEALTHY } } }
I20260812 00:00:10.694103 28682 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 00:00:10.721446 28669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.718285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:43721 (local address 127.0.0.1:58800)
0812 00:00:10.718421 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:10.718438 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:10.718508 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:10.718769 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:10.718770 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:10.718772 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:00:10.718852 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.718855 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.719533 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.719534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.720155 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.720157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.720837 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.720839 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.720931 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.720955 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:00:10.721242 (+ 287us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:00:10.721250 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 00:00:10.721291 (+ 41us) client_negotiation.cc:240] Negotiation successful
0812 00:00:10.721374 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260812 00:00:10.721446 28607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.718524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58800 (local address 127.25.103.67:43721)
0812 00:00:10.718602 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:10.718604 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:10.718613 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:10.718654 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:10.718655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:10.718677 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:10.718743 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:10.718919 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.719458 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.720326 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.720675 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.720792 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.721063 (+ 271us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:10.721182 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:10.721248 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:10.721306 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 00:00:10.721338 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 00:00:10.723722 28073 raft_consensus.cc:1261] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e [term 1 FOLLOWER]: Refusing update from remote peer 407fab3e61494759ad8575f4aa3b937d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:10.723816 28290 raft_consensus.cc:1261] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94 [term 1 FOLLOWER]: Refusing update from remote peer 407fab3e61494759ad8575f4aa3b937d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:10.724153 28680 consensus_queue.cc:1035] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:10.724331 28620 consensus_queue.cc:1035] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d [LEADER]: Connected to new peer: Peer: permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:10.724957 28619 tablet_replica.cc:439] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e: TxnStatusTablet state changed. Reason: New leader 407fab3e61494759ad8575f4aa3b937d. Latest consensus state: current_term: 1 leader_uuid: "407fab3e61494759ad8575f4aa3b937d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } } }
I20260812 00:00:10.725080 28619 tablet_replica.cc:442] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:10.725070 28626 tablet_replica.cc:439] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94: TxnStatusTablet state changed. Reason: New leader 407fab3e61494759ad8575f4aa3b937d. Latest consensus state: current_term: 1 leader_uuid: "407fab3e61494759ad8575f4aa3b937d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } } }
I20260812 00:00:10.725148 28626 tablet_replica.cc:442] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:10.726189 28619 tablet_replica.cc:439] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "407fab3e61494759ad8575f4aa3b937d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } } }
I20260812 00:00:10.726230 28688 mvcc.cc:205] Tried to move back new op lower bound from 7317474552721846272 to 7317474552587956224. Current Snapshot: MvccSnapshot[applied={T|T < 7317474552721846272}]
I20260812 00:00:10.726212 28680 tablet_replica.cc:439] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "407fab3e61494759ad8575f4aa3b937d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } } }
I20260812 00:00:10.726274 28619 tablet_replica.cc:442] T 280f7017da3b40eda9088636bc2d5545 P 884b9384981b4b159ffad69cb58cfc9e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:10.726295 28680 tablet_replica.cc:442] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:00:10.726348 28680 tablet_replica.cc:439] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "407fab3e61494759ad8575f4aa3b937d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } } }
I20260812 00:00:10.726514 28680 tablet_replica.cc:442] T 280f7017da3b40eda9088636bc2d5545 P 407fab3e61494759ad8575f4aa3b937d: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:00:10.730902 28626 tablet_replica.cc:439] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "407fab3e61494759ad8575f4aa3b937d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884b9384981b4b159ffad69cb58cfc9e" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46469 } } peers { permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 } } peers { permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 } } }
I20260812 00:00:10.731026 28626 tablet_replica.cc:442] T 280f7017da3b40eda9088636bc2d5545 P a4bef64c972a493999afc673edbbfc94: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:10.731748 28691 mvcc.cc:205] Tried to move back new op lower bound from 7317474552721846272 to 7317474552587956224. Current Snapshot: MvccSnapshot[applied={T|T < 7317474552721846272 or (T in {7317474552721846272})}]
I20260812 00:00:10.736577 28679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.732677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39046 (local address 127.25.103.65:46469)
0812 00:00:10.732730 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:10.732732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:10.734166 (+ 1434us) server_negotiation.cc:407] Connection header received
0812 00:00:10.734249 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:10.734251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:10.734272 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:10.734337 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:10.734467 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.734968 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.735817 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.736016 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.736074 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.736232 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:10.736344 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:10.736407 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:10.736451 (+ 44us) server_negotiation.cc:299] Negotiation successful
0812 00:00:10.736485 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:00:10.743264 28705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.740506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:43721 (local address 127.25.103.65:40541)
0812 00:00:10.740678 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:10.740690 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:10.740756 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:10.740907 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:10.740909 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:10.740911 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:00:10.741013 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.741016 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.741649 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.741651 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.742341 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.742348 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.742826 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.742827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.742880 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.742898 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:00:10.743064 (+ 166us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:00:10.743066 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:00:10.743111 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 00:00:10.743172 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":89,"threads_started":1}
I20260812 00:00:10.743240 28607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.740635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:40541 (local address 127.25.103.67:43721)
0812 00:00:10.740730 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:10.740733 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:10.740744 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:00:10.740837 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:10.740838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:10.740850 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:10.740900 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:10.741066 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.741569 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.742433 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.742725 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.742811 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.742971 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:10.743012 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:10.743053 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:10.743130 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 00:00:10.743154 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 00:00:10.747054 28288 raft_consensus.cc:1261] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94 [term 1 FOLLOWER]: Refusing update from remote peer 884b9384981b4b159ffad69cb58cfc9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:10.747044 28498 raft_consensus.cc:1261] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d [term 1 FOLLOWER]: Refusing update from remote peer 884b9384981b4b159ffad69cb58cfc9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:10.747498 28660 consensus_queue.cc:1035] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bef64c972a493999afc673edbbfc94" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:10.747768 28619 consensus_queue.cc:1035] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "407fab3e61494759ad8575f4aa3b937d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:10.757902 28679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.755466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:42001 (local address 127.25.103.65:46469)
0812 00:00:10.755507 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:10.755509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:10.755517 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:00:10.755564 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:10.755564 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:10.755576 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:10.755618 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:10.755793 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.756279 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.757051 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.757238 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.757294 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.757489 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:10.757554 (+ 65us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:10.757622 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:10.757776 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 00:00:10.757814 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:00:10.757992 28713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.755279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:46469 (local address 127.25.103.67:42001)
0812 00:00:10.755430 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:10.755442 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:10.755505 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:10.755668 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:10.755669 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:10.755674 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:00:10.755736 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.755739 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.756361 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.756362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.756965 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:10.756967 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.757308 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.757309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:10.757369 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.757387 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:00:10.757689 (+ 302us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:00:10.757693 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:00:10.757750 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 00:00:10.757838 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":84,"threads_started":1}
I20260812 00:00:10.773222 27811 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:10.773367 27811 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:10.774114 27811 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 03bae27f738e44ec8c2c86088d294593: Sending DeleteTablet for 3 replicas of tablet 33e943909bcd48b082a438009ae03d11
I20260812 00:00:10.774475 28471 tablet_service.cc:1514] Processing DeleteTablet for tablet 33e943909bcd48b082a438009ae03d11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:10 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:58790
I20260812 00:00:10.774559 28260 tablet_service.cc:1514] Processing DeleteTablet for tablet 33e943909bcd48b082a438009ae03d11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:10 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:46162
I20260812 00:00:10.774849 28039 tablet_service.cc:1514] Processing DeleteTablet for tablet 33e943909bcd48b082a438009ae03d11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:10 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:39040
I20260812 00:00:10.774894 28718 tablet_replica.cc:330] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d: stopping tablet replica
I20260812 00:00:10.774951 28718 raft_consensus.cc:2229] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:10.774991 28718 raft_consensus.cc:2258] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:10.775295 28718 ts_tablet_manager.cc:1905] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:10.775957 28724 tablet_replica.cc:330] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e: stopping tablet replica
I20260812 00:00:10.776091 28724 raft_consensus.cc:2229] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:00:10.776242 28724 raft_consensus.cc:2258] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:10.776593 28724 ts_tablet_manager.cc:1905] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:10.778055 28718 ts_tablet_manager.cc:1918] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:00:10.778060 28721 tablet_replica.cc:330] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94: stopping tablet replica
I20260812 00:00:10.778136 28721 raft_consensus.cc:2229] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:10.778200 28718 log.cc:1196] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/33e943909bcd48b082a438009ae03d11
I20260812 00:00:10.778460 28718 ts_tablet_manager.cc:1939] T 33e943909bcd48b082a438009ae03d11 P 407fab3e61494759ad8575f4aa3b937d: Deleting consensus metadata
I20260812 00:00:10.778637 28721 raft_consensus.cc:2258] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:10.778921 27788 catalog_manager.cc:4841] TS 407fab3e61494759ad8575f4aa3b937d (127.25.103.67:43721): tablet 33e943909bcd48b082a438009ae03d11 (table test-table [id=a00e254a31444936b4d7c2f3233ddab9]) successfully deleted
I20260812 00:00:10.779198 28721 ts_tablet_manager.cc:1905] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:10.780973 28721 ts_tablet_manager.cc:1918] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:00:10.781045 28721 log.cc:1196] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/33e943909bcd48b082a438009ae03d11
I20260812 00:00:10.781271 28721 ts_tablet_manager.cc:1939] T 33e943909bcd48b082a438009ae03d11 P a4bef64c972a493999afc673edbbfc94: Deleting consensus metadata
I20260812 00:00:10.781674 27790 catalog_manager.cc:4841] TS a4bef64c972a493999afc673edbbfc94 (127.25.103.66:41249): tablet 33e943909bcd48b082a438009ae03d11 (table test-table [id=a00e254a31444936b4d7c2f3233ddab9]) successfully deleted
I20260812 00:00:10.783512 28724 ts_tablet_manager.cc:1918] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:00:10.783589 28724 log.cc:1196] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492802321514-26013-0/minicluster-data/ts-0/wal/wals/33e943909bcd48b082a438009ae03d11
I20260812 00:00:10.783823 28724 ts_tablet_manager.cc:1939] T 33e943909bcd48b082a438009ae03d11 P 884b9384981b4b159ffad69cb58cfc9e: Deleting consensus metadata
I20260812 00:00:10.784190 27789 catalog_manager.cc:4841] TS 884b9384981b4b159ffad69cb58cfc9e (127.25.103.65:46469): tablet 33e943909bcd48b082a438009ae03d11 (table test-table [id=a00e254a31444936b4d7c2f3233ddab9]) successfully deleted
Aug 12 00:00:10 dist-test-slave-vpvm krb5kdc[27730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492809, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.103.65@KRBTEST.COM
I20260812 00:00:10.799314 28679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.778542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39048 (local address 127.25.103.65:46469)
0812 00:00:10.778590 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:10.778593 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:10.784615 (+ 6022us) server_negotiation.cc:407] Connection header received
0812 00:00:10.784722 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:10.784723 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:10.784734 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:10.784762 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:10.785552 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.786326 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.787402 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.787717 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.787757 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.794413 (+ 6656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:10.794428 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:10.794429 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:10.794440 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:10.797035 (+ 2595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:10.797775 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:10.797781 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:10.797781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:10.797898 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:10.798163 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:10.798164 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:10.798164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:10.798426 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:10.798617 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:10.798963 (+ 346us) server_negotiation.cc:299] Negotiation successful
0812 00:00:10.799099 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260812 00:00:10.800266 28143 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39048
I20260812 00:00:10.812680 28670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:10.803097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34478 (local address 127.25.103.126:36929)
0812 00:00:10.803168 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:10.803170 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:10.803229 (+ 59us) server_negotiation.cc:407] Connection header received
0812 00:00:10.803308 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:10.803309 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:10.803323 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:10.803401 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:10.804190 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.805003 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.806133 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:10.806464 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:10.806509 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:10.808896 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:10.808898 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:10.808898 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:10.808908 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:10.811162 (+ 2254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:10.811622 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:10.811623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:10.811624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:10.811685 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:10.812000 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:10.812001 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:10.812001 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:10.812164 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:10.812250 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:10.812465 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 00:00:10.812573 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260812 00:00:10.813237 27811 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34478
I20260812 00:00:10.814019 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 27929
I20260812 00:00:10.836126 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 28167
I20260812 00:00:10.862587 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 28367
I20260812 00:00:10.885110 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 27748
2026-08-12T00:00:10Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3278 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:00:10 dist-test-slave-vpvm krb5kdc[28735](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:00:10 dist-test-slave-vpvm krb5kdc[28735](info): set up 2 sockets
Aug 12 00:00:10 dist-test-slave-vpvm krb5kdc[28735](info): commencing operation
krb5kdc: starting...
W20260812 00:00:12.119230 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:00:12 dist-test-slave-vpvm krb5kdc[28735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:00:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:00:12.273715 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:41093
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:39351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:41093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:12.372198 28759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:12.372452 28759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:12.372478 28759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:12.373751 28759 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:12.373795 28759 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 00:00:12.373807 28759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:12.373819 28759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:12.373831 28759 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:12.373842 28759 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:00:12.375861 28759 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:39351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:41093
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:41093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:12.376180 28759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:12.376410 28759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:12.381880 28769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:12.381991 28759 server_base.cc:1034] running on GCE node
W20260812 00:00:12.381917 28766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:12.381884 28767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:12.382572 28759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:12.383170 28759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:12.384439 28759 hybrid_clock.cc:648] HybridClock initialized: now 1786492812384400 us; error 68 us; skew 500 ppm
Aug 12 00:00:12 dist-test-slave-vpvm krb5kdc[28735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492812, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:12.387370 28759 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:00:12.387868 28759 webserver.cc:460] Webserver started at http://127.25.103.126:41265/ using document root <none> and password file <none>
I20260812 00:00:12.388118 28759 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:12.388166 28759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:12.388283 28759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:12.389395 28759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "b08561f132e14f6dbf0b04e88df79b32"
format_stamp: "Formatted at 2026-08-12 00:00:12 on dist-test-slave-vpvm"
server_key: "8c8d2b38c02c415a575cd6716aa8b26f"
server_key_iv: "ae5366dc0dd608952f213fc21b9fd815"
server_key_version: "encryptionkey@0"
I20260812 00:00:12.389772 28759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "b08561f132e14f6dbf0b04e88df79b32"
format_stamp: "Formatted at 2026-08-12 00:00:12 on dist-test-slave-vpvm"
server_key: "8c8d2b38c02c415a575cd6716aa8b26f"
server_key_iv: "ae5366dc0dd608952f213fc21b9fd815"
server_key_version: "encryptionkey@0"
I20260812 00:00:12.391348 28759 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:00:12.392314 28782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:12.392568 28759 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:12.392668 28759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "b08561f132e14f6dbf0b04e88df79b32"
format_stamp: "Formatted at 2026-08-12 00:00:12 on dist-test-slave-vpvm"
server_key: "8c8d2b38c02c415a575cd6716aa8b26f"
server_key_iv: "ae5366dc0dd608952f213fc21b9fd815"
server_key_version: "encryptionkey@0"
I20260812 00:00:12.392737 28759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:12.417735 28759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:12.420619 28759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:12.420794 28759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:12.427242 28759 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:41093
I20260812 00:00:12.427304 28870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:41093 every 8 connection(s)
I20260812 00:00:12.427670 28759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:12.428387 28871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:12.430900 28871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32: Bootstrap starting.
I20260812 00:00:12.431499 28871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:12.431733 28871 log.cc:824] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:12.432421 28871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32: No bootstrap required, opened a new log
I20260812 00:00:12.432474 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 28759
I20260812 00:00:12.432588 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:00:12.432744 26013 external_mini_cluster.cc:1428] Setting key a6a70112ea066b707d76fc5b40829845
I20260812 00:00:12.435392 28871 raft_consensus.cc:348] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b08561f132e14f6dbf0b04e88df79b32" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 41093 } }
I20260812 00:00:12.435768 28871 raft_consensus.cc:374] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:12.435843 28871 raft_consensus.cc:729] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b08561f132e14f6dbf0b04e88df79b32, State: Initialized, Role: FOLLOWER
I20260812 00:00:12.436067 28871 consensus_queue.cc:260] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b08561f132e14f6dbf0b04e88df79b32" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 41093 } }
I20260812 00:00:12.436162 28871 raft_consensus.cc:388] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:12.436189 28871 raft_consensus.cc:482] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:12.436231 28871 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:12.437321 28871 raft_consensus.cc:504] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b08561f132e14f6dbf0b04e88df79b32" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 41093 } }
I20260812 00:00:12.437494 28871 leader_election.cc:302] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b08561f132e14f6dbf0b04e88df79b32; no voters:
I20260812 00:00:12.437696 28871 leader_election.cc:288] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:00:12.437801 28878 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:12.437986 28878 raft_consensus.cc:686] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32 [term 1 LEADER]: Becoming Leader. State: Replica: b08561f132e14f6dbf0b04e88df79b32, State: Running, Role: LEADER
I20260812 00:00:12.438112 28878 consensus_queue.cc:237] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b08561f132e14f6dbf0b04e88df79b32" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 41093 } }
I20260812 00:00:12.438004 28871 sys_catalog.cc:564] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:12.438503 28880 sys_catalog.cc:455] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b08561f132e14f6dbf0b04e88df79b32. Latest consensus state: current_term: 1 leader_uuid: "b08561f132e14f6dbf0b04e88df79b32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b08561f132e14f6dbf0b04e88df79b32" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 41093 } } }
I20260812 00:00:12.438580 28880 sys_catalog.cc:458] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:12.438740 28879 sys_catalog.cc:455] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b08561f132e14f6dbf0b04e88df79b32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b08561f132e14f6dbf0b04e88df79b32" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 41093 } } }
I20260812 00:00:12.438799 28879 sys_catalog.cc:458] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:12.438908 28884 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:12.439468 28884 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:00:12.441520 28884 catalog_manager.cc:1347] Generated new cluster ID: 11a9e457f6dd436ab8c884e894c4ad21
I20260812 00:00:12.441584 28884 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:00:12 dist-test-slave-vpvm krb5kdc[28735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:12.449046 28876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:12.433278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34106 (local address 127.25.103.126:41093)
0812 00:00:12.433470 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:12.433480 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:12.433517 (+ 37us) server_negotiation.cc:407] Connection header received
0812 00:00:12.435316 (+ 1799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:12.435333 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:12.435456 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:12.435824 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:12.436635 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:12.438102 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:12.439139 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:12.439761 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:12.440219 (+ 458us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:12.445416 (+ 5197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:12.445422 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:12.445423 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:12.445438 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:12.447109 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:12.447659 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:12.447662 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:12.447663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:12.447804 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:12.448033 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:12.448034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:12.448035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:12.448336 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:12.448532 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:12.448655 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 00:00:12.448818 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":89,"threads_started":1}
I20260812 00:00:12.457978 28884 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:00:12.458596 28884 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:12.468760 28884 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32: Generated new TSK 0
I20260812 00:00:12.468989 28884 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
I20260812 00:00:12.518584 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:41093
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:39351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:12.646409 28908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:12.646636 28908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:12.646667 28908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:12.647897 28908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:12.647938 28908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:12.647958 28908 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 00:00:12.647969 28908 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:00:12.647985 28908 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:00:12.649488 28908 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:39351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.103.126:41093
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28908
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:12.649706 28908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:12.649904 28908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:12.654910 28924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:12.654910 28927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:12.655040 28922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:12.655045 28908 server_base.cc:1034] running on GCE node
I20260812 00:00:12.655329 28908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:12.655596 28908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:12.656739 28908 hybrid_clock.cc:648] HybridClock initialized: now 1786492812656727 us; error 38 us; skew 500 ppm
Aug 12 00:00:12 dist-test-slave-vpvm krb5kdc[28735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492812, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:12.659461 28908 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:00:12.659952 28908 webserver.cc:460] Webserver started at http://127.25.103.65:45101/ using document root <none> and password file <none>
I20260812 00:00:12.660187 28908 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:12.660235 28908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:12.660362 28908 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:12.661432 28908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "3fc817616be34ae59d8c2d8546c5537d"
format_stamp: "Formatted at 2026-08-12 00:00:12 on dist-test-slave-vpvm"
server_key: "973b6ce4356164e8e745687fc5a410f3"
server_key_iv: "e629f65056ce8d94eb403f51b6f20123"
server_key_version: "encryptionkey@0"
I20260812 00:00:12.661780 28908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "3fc817616be34ae59d8c2d8546c5537d"
format_stamp: "Formatted at 2026-08-12 00:00:12 on dist-test-slave-vpvm"
server_key: "973b6ce4356164e8e745687fc5a410f3"
server_key_iv: "e629f65056ce8d94eb403f51b6f20123"
server_key_version: "encryptionkey@0"
I20260812 00:00:12.663326 28908 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:12.664314 28937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:12.664522 28908 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:12.664633 28908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "3fc817616be34ae59d8c2d8546c5537d"
format_stamp: "Formatted at 2026-08-12 00:00:12 on dist-test-slave-vpvm"
server_key: "973b6ce4356164e8e745687fc5a410f3"
server_key_iv: "e629f65056ce8d94eb403f51b6f20123"
server_key_version: "encryptionkey@0"
I20260812 00:00:12.664705 28908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:12.680158 28908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:12.682613 28908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:12.682773 28908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:12.683367 28908 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:12.683491 28908 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:12.683547 28908 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:12.683570 28908 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:00:12 dist-test-slave-vpvm krb5kdc[28735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492812, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:12.691076 28908 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:40057
I20260812 00:00:12.691210 29102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:40057 every 8 connection(s)
I20260812 00:00:12.691715 28908 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:00:12.693210 28876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:12.683880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:58671 (local address 127.25.103.126:41093)
0812 00:00:12.683933 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:12.683935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:12.684169 (+ 234us) server_negotiation.cc:407] Connection header received
0812 00:00:12.684708 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:12.684709 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:12.684722 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:12.684777 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:12.685537 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:12.686133 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:12.687377 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:12.687609 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:12.687668 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:12.690356 (+ 2688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:12.690359 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:12.690359 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:12.690373 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:12.691839 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:12.692268 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:12.692269 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:12.692270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:12.692324 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:12.692569 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:12.692570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:12.692571 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:12.692693 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:12.692749 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:12.693025 (+ 276us) server_negotiation.cc:299] Negotiation successful
0812 00:00:12.693119 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:00:12.693367 28953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:12.683876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:41093 (local address 127.25.103.65:58671)
0812 00:00:12.684048 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:12.684084 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:12.684607 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:12.684846 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:12.684850 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:12.685150 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:12.685440 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:12.685447 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:12.686226 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:12.686227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:12.687286 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:12.687289 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:12.687683 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:12.687684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:12.687814 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:12.688369 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:12.688381 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:12.690265 (+ 1884us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:12.691946 (+ 1681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:12.691952 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:12.691954 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:12.692202 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:12.692390 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:12.692391 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:12.692391 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:12.692501 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:12.692751 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:12.692758 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:12.692897 (+ 139us) client_negotiation.cc:769] Sending connection context
0812 00:00:12.692988 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 00:00:12.693154 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":86,"threads_started":1}
I20260812 00:00:12.693876 29103 heartbeater.cc:347] Connected to a master server at 127.25.103.126:41093
I20260812 00:00:12.693984 29103 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:12.694170 29103 heartbeater.cc:511] Master 127.25.103.126:41093 requested a full tablet report, sending...
I20260812 00:00:12.694834 28807 ts_manager.cc:194] Registered new tserver with Master: 3fc817616be34ae59d8c2d8546c5537d (127.25.103.65:40057)
I20260812 00:00:12.695713 28807 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:58671
I20260812 00:00:12.696928 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 28908
I20260812 00:00:12.697033 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:00:12.697239 26013 external_mini_cluster.cc:1428] Setting key bd1146ce1f4b4ec2cd6f4255ef8e3ad9
I20260812 00:00:12.701125 29112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:12.695032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:41093 (local address 127.25.103.65:60685)
0812 00:00:12.695183 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:12.695193 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:12.695253 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:12.695369 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:12.695369 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:12.695568 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:12.695638 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:12.695640 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:12.696361 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:12.696363 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:12.697038 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:12.697041 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:12.697481 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:12.697482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:12.697556 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:12.698141 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:12.698146 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:12.698580 (+ 434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:12.700135 (+ 1555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:12.700136 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:12.700137 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:12.700314 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:12.700512 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:12.700512 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:12.700513 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:12.700563 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:12.700888 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:12.700889 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:12.700928 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 00:00:12.700968 (+ 40us) client_negotiation.cc:240] Negotiation successful
0812 00:00:12.701055 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":77,"threads_started":1}
I20260812 00:00:12.701189 28876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:12.695077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:60685 (local address 127.25.103.126:41093)
0812 00:00:12.695128 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:12.695130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:12.695267 (+ 137us) server_negotiation.cc:407] Connection header received
0812 00:00:12.695296 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:12.695297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:12.695306 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:12.695357 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:12.695703 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:12.696278 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:12.697132 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:12.697360 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:12.697421 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:12.698669 (+ 1248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:12.698671 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:12.698671 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:12.698678 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:12.700033 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:12.700377 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:12.700378 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:12.700378 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:12.700443 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:12.700610 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:12.700611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:12.700611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:12.700820 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:12.700904 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:12.701007 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 00:00:12.701097 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
WARNING: no policy specified for kudu/127.25.103.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
I20260812 00:00:12.728802 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:41093
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:39351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:12.818701 29115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:12.818934 29115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:12.818961 29115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:12.820501 29115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:12.820568 29115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:12.820592 29115 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 00:00:12.820603 29115 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:00:12.820621 29115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:00:12.822599 29115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:39351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.103.126:41093
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29115
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:12.822916 29115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:12.823184 29115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:12.828588 29126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:12.828609 29132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:12.828588 29127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:12.828733 29115 server_base.cc:1034] running on GCE node
I20260812 00:00:12.829034 29115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:12.829283 29115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:12.830432 29115 hybrid_clock.cc:648] HybridClock initialized: now 1786492812830402 us; error 47 us; skew 500 ppm
Aug 12 00:00:12 dist-test-slave-vpvm krb5kdc[28735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492812, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:12.833360 29115 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:00:12.833850 29115 webserver.cc:460] Webserver started at http://127.25.103.66:43293/ using document root <none> and password file <none>
I20260812 00:00:12.834102 29115 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:12.834164 29115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:12.834295 29115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:12.835388 29115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "d7c95b21c2b24c55be9a1f3e55c72936"
format_stamp: "Formatted at 2026-08-12 00:00:12 on dist-test-slave-vpvm"
server_key: "eb1c11e1790a818579080445cfb21812"
server_key_iv: "263a1dea6ee16d93e303f94e3d06e3df"
server_key_version: "encryptionkey@0"
I20260812 00:00:12.835883 29115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "d7c95b21c2b24c55be9a1f3e55c72936"
format_stamp: "Formatted at 2026-08-12 00:00:12 on dist-test-slave-vpvm"
server_key: "eb1c11e1790a818579080445cfb21812"
server_key_iv: "263a1dea6ee16d93e303f94e3d06e3df"
server_key_version: "encryptionkey@0"
I20260812 00:00:12.837563 29115 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:00:12.838406 29143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:12.838595 29115 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:00:12.838692 29115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "d7c95b21c2b24c55be9a1f3e55c72936"
format_stamp: "Formatted at 2026-08-12 00:00:12 on dist-test-slave-vpvm"
server_key: "eb1c11e1790a818579080445cfb21812"
server_key_iv: "263a1dea6ee16d93e303f94e3d06e3df"
server_key_version: "encryptionkey@0"
I20260812 00:00:12.838765 29115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:12.852401 29115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:12.854694 29115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:12.854866 29115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:12.855499 29115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:12.855542 29115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:12.855576 29115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:12.855597 29115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:00:12 dist-test-slave-vpvm krb5kdc[28735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492812, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:12.864233 29115 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:46489
I20260812 00:00:12.864300 29327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:46489 every 8 connection(s)
I20260812 00:00:12.864714 29115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:00:12.865247 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 29115
I20260812 00:00:12.865343 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:00:12.865598 26013 external_mini_cluster.cc:1428] Setting key c1363bcb5320abaf53222e6fe5983238
I20260812 00:00:12.866272 28876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:12.856005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:52879 (local address 127.25.103.126:41093)
0812 00:00:12.856057 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:12.856059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:12.856366 (+ 307us) server_negotiation.cc:407] Connection header received
0812 00:00:12.856901 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:12.856903 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:12.856916 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:12.856969 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:12.857654 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:12.858281 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:12.859321 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:12.859561 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:12.859620 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:12.862778 (+ 3158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:12.862780 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:12.862781 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:12.862859 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:12.864590 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:12.865133 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:12.865135 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:12.865135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:12.865204 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:12.865499 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:12.865500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:12.865500 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:12.865625 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:12.865683 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:12.866089 (+ 406us) server_negotiation.cc:299] Negotiation successful
0812 00:00:12.866175 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:00:12.866427 29157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:12.856066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:41093 (local address 127.25.103.66:52879)
0812 00:00:12.856249 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:12.856284 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:12.856801 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:12.857042 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:12.857045 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:12.857338 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:12.857561 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:12.857567 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:12.858371 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:12.858372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:12.859230 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:12.859233 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:12.859637 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:12.859638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:12.859757 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:12.860304 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:12.860317 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:12.862679 (+ 2362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:12.864692 (+ 2013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:12.864698 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:12.864700 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:12.865009 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:12.865275 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:12.865276 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:12.865277 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:12.865422 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:12.865750 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:12.865758 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:12.865920 (+ 162us) client_negotiation.cc:769] Sending connection context
0812 00:00:12.866050 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 00:00:12.866194 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":104,"threads_started":1}
I20260812 00:00:12.868357 29331 heartbeater.cc:347] Connected to a master server at 127.25.103.126:41093
I20260812 00:00:12.868445 29331 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:12.868641 29331 heartbeater.cc:511] Master 127.25.103.126:41093 requested a full tablet report, sending...
I20260812 00:00:12.869016 28807 ts_manager.cc:194] Registered new tserver with Master: d7c95b21c2b24c55be9a1f3e55c72936 (127.25.103.66:46489)
I20260812 00:00:12.869480 28807 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:52879
WARNING: no policy specified for kudu/127.25.103.67@KRBTEST.COM; defaulting to no policy
I20260812 00:00:12.876473 28876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:12.870273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:46373 (local address 127.25.103.126:41093)
0812 00:00:12.870322 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:12.870324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:12.870499 (+ 175us) server_negotiation.cc:407] Connection header received
0812 00:00:12.870534 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:12.870536 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:12.870548 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:12.870618 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:12.871016 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:12.871512 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:12.872504 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:12.872706 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:12.872779 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:12.873818 (+ 1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:12.873819 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:12.873820 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:12.873826 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:12.875197 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:12.875562 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:12.875563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:12.875563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:12.875626 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:12.875920 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:12.875922 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:12.875922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:12.876086 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:12.876151 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:12.876290 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 00:00:12.876373 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:00:12.876487 29341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:12.870216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:41093 (local address 127.25.103.66:46373)
0812 00:00:12.870395 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:12.870406 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:12.870473 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:12.870633 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:12.870634 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:12.870850 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:12.870922 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:12.870924 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:12.871609 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:12.871610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:12.872403 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:12.872405 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:12.872790 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:12.872791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:12.872869 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:12.873314 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:12.873319 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:12.873726 (+ 407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:12.875282 (+ 1556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:12.875283 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:12.875284 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:12.875475 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:12.875755 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:12.875757 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:12.875757 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:12.875841 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:12.876152 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:12.876153 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:12.876205 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 00:00:12.876260 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 00:00:12.876375 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":69,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
I20260812 00:00:12.893224 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:41093
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:39351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:12.980546 29343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:12.980822 29343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:12.980852 29343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:12.982532 29343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:12.982610 29343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:12.982635 29343 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 00:00:12.982647 29343 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:00:12.982664 29343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:00:12.984637 29343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:39351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.103.126:41093
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:12.984896 29343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:12.985121 29343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:12.990302 29353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:12.990386 29343 server_base.cc:1034] running on GCE node
W20260812 00:00:12.990311 29352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:12.990307 29355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:12.990744 29343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:12.990986 29343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:12.992141 29343 hybrid_clock.cc:648] HybridClock initialized: now 1786492812992123 us; error 33 us; skew 500 ppm
Aug 12 00:00:12 dist-test-slave-vpvm krb5kdc[28735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492812, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:12.994824 29343 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:00:12.995313 29343 webserver.cc:460] Webserver started at http://127.25.103.67:45801/ using document root <none> and password file <none>
I20260812 00:00:12.995535 29343 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:12.995585 29343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:12.995718 29343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:12.996933 29343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "ccd5032985984df4af23751368a42d4e"
format_stamp: "Formatted at 2026-08-12 00:00:12 on dist-test-slave-vpvm"
server_key: "6c189434ed14d0d0c3f30617ce9e0e52"
server_key_iv: "1b9e640782609e356c0e03af26e565de"
server_key_version: "encryptionkey@0"
I20260812 00:00:12.997412 29343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "ccd5032985984df4af23751368a42d4e"
format_stamp: "Formatted at 2026-08-12 00:00:12 on dist-test-slave-vpvm"
server_key: "6c189434ed14d0d0c3f30617ce9e0e52"
server_key_iv: "1b9e640782609e356c0e03af26e565de"
server_key_version: "encryptionkey@0"
I20260812 00:00:12.998935 29343 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260812 00:00:12.999804 29366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:12.999967 29343 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:13.000059 29343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "ccd5032985984df4af23751368a42d4e"
format_stamp: "Formatted at 2026-08-12 00:00:12 on dist-test-slave-vpvm"
server_key: "6c189434ed14d0d0c3f30617ce9e0e52"
server_key_iv: "1b9e640782609e356c0e03af26e565de"
server_key_version: "encryptionkey@0"
I20260812 00:00:13.000125 29343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:13.011899 29343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:13.013768 29343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:13.013923 29343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:13.014520 29343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:13.014562 29343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:13.014593 29343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:13.014617 29343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:00:13 dist-test-slave-vpvm krb5kdc[28735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492812, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:13.021484 29343 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:35953
I20260812 00:00:13.021582 29545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:35953 every 8 connection(s)
I20260812 00:00:13.021904 29343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:00:13.023592 28876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.014960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:52121 (local address 127.25.103.126:41093)
0812 00:00:13.015010 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:13.015012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:13.015220 (+ 208us) server_negotiation.cc:407] Connection header received
0812 00:00:13.015768 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:13.015770 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:13.015782 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:13.015833 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:13.016501 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.017020 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.018064 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.018254 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.018309 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.020857 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:13.020859 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:13.020859 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:13.020868 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:13.022489 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:13.022846 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:13.022847 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:13.022847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:13.022909 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:13.023087 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:13.023087 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:13.023087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:13.023200 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:13.023244 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:13.023460 (+ 216us) server_negotiation.cc:299] Negotiation successful
0812 00:00:13.023526 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:00:13.023766 29379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.014946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:41093 (local address 127.25.103.67:52121)
0812 00:00:13.015095 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:13.015131 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:13.015662 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:13.015905 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:13.015909 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:13.016200 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:13.016405 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.016409 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.017109 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.017110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.017978 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.017981 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.018324 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.018325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.018462 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.018912 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:13.018920 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:13.020770 (+ 1850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:13.022561 (+ 1791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:13.022566 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:13.022568 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:13.022784 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:13.022959 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:13.022960 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:13.022960 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:13.023046 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:13.023236 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:13.023239 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:13.023346 (+ 107us) client_negotiation.cc:769] Sending connection context
0812 00:00:13.023437 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 00:00:13.023562 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
I20260812 00:00:13.024240 29547 heartbeater.cc:347] Connected to a master server at 127.25.103.126:41093
I20260812 00:00:13.024323 29547 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:13.024613 29547 heartbeater.cc:511] Master 127.25.103.126:41093 requested a full tablet report, sending...
I20260812 00:00:13.025079 28808 ts_manager.cc:194] Registered new tserver with Master: ccd5032985984df4af23751368a42d4e (127.25.103.67:35953)
I20260812 00:00:13.025492 28808 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:52121
I20260812 00:00:13.030207 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 29343
I20260812 00:00:13.030293 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:00:13.030481 26013 external_mini_cluster.cc:1428] Setting key 4632be1ec73efafae9d92c3de4b42478
I20260812 00:00:13.030539 29556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.025376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:41093 (local address 127.25.103.67:33061)
0812 00:00:13.025502 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:13.025512 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:13.025568 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:13.025706 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:13.025707 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:13.025864 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:13.025920 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.025922 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.026564 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.026564 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.027078 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.027079 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.027405 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.027406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.027491 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.027878 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:13.027883 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:13.028161 (+ 278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:13.029367 (+ 1206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:13.029368 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:13.029368 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:13.029540 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:13.029714 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:13.029715 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:13.029715 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:13.029774 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:13.030206 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:13.030207 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:13.030253 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 00:00:13.030326 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 00:00:13.030450 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":70,"threads_started":1}
I20260812 00:00:13.030558 28876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.025448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:33061 (local address 127.25.103.126:41093)
0812 00:00:13.025513 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:13.025515 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:13.025559 (+ 44us) server_negotiation.cc:407] Connection header received
0812 00:00:13.025619 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:13.025619 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:13.025629 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:13.025699 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:13.026007 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.026479 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.027149 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.027349 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.027401 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.028248 (+ 847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:13.028249 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:13.028249 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:13.028256 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:13.029295 (+ 1039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:13.029603 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:13.029604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:13.029605 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:13.029661 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:13.029825 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:13.029826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:13.029826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:13.030101 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:13.030187 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:13.030363 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 00:00:13.030456 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 00:00:13.031522 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:00:13 dist-test-slave-vpvm krb5kdc[28735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492813, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:00:13 dist-test-slave-vpvm krb5kdc[28735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492813, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:13.055989 28876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.049229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34108 (local address 127.25.103.126:41093)
0812 00:00:13.049290 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:13.049292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:13.049300 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:00:13.049326 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:13.049327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:13.049336 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:13.049383 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:13.050043 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.050561 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.051300 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.051501 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.051554 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.053760 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:13.053761 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:13.053761 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:13.053770 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:13.055024 (+ 1254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:13.055330 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:13.055331 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:13.055331 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:13.055377 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:13.055590 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:13.055591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:13.055591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:13.055700 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:13.055772 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:13.055851 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 00:00:13.055915 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:00:13.058122 28807 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34108:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:00:13.060096 28807 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:00:13.067597 29574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.063100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:40057 (local address 127.0.0.1:57306)
0812 00:00:13.063398 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:13.063439 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:13.063534 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:13.064044 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:13.064045 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:13.064047 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:13.064093 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.064095 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.065281 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.065282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.066368 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.066371 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.067258 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.067259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.067342 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.067356 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 00:00:13.067433 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:00:13.067492 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"mutex_wait_us":32,"thread_start_us":144,"threads_started":1}
I20260812 00:00:13.067641 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.063527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57306 (local address 127.25.103.65:40057)
0812 00:00:13.063863 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:13.063867 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:13.063876 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:13.063909 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:13.063911 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:13.063924 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:13.063998 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:13.064162 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.065195 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.066450 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.067092 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.067163 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.067223 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:13.067465 (+ 242us) server_negotiation.cc:299] Negotiation successful
0812 00:00:13.067516 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":78,"threads_started":1}
I20260812 00:00:13.067852 29575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.063100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:35953 (local address 127.0.0.1:36858)
0812 00:00:13.063513 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:13.063524 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:13.063579 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:13.063805 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:13.063808 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:13.063811 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:13.063950 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.063952 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.065274 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.065275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.066713 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.066715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.067642 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.067643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.067726 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.067731 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:00:13.067763 (+ 32us) client_negotiation.cc:240] Negotiation successful
0812 00:00:13.067805 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":79,"thread_start_us":93,"threads_started":1}
I20260812 00:00:13.068259 29577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.063328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36858 (local address 127.25.103.67:35953)
0812 00:00:13.063493 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:13.063497 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:13.063571 (+ 74us) server_negotiation.cc:407] Connection header received
0812 00:00:13.063643 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:13.063665 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:13.063683 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:13.063773 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:13.064014 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.065161 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.066793 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.067550 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.068017 (+ 467us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.068095 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:13.068123 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 00:00:13.068167 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":87,"threads_started":1}
I20260812 00:00:13.068369 29576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.063131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:46489 (local address 127.0.0.1:34316)
0812 00:00:13.063695 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:13.063706 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:13.063761 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:13.064226 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:13.064226 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:13.064228 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:13.064256 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.064257 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.065235 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.065236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.066697 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.066700 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.067554 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.067555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.067625 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.067630 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:00:13.068227 (+ 597us) client_negotiation.cc:240] Negotiation successful
0812 00:00:13.068286 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"mutex_wait_us":130,"thread_start_us":128,"threads_started":1}
I20260812 00:00:13.068703 29578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.063372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34316 (local address 127.25.103.66:46489)
0812 00:00:13.063692 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:13.063696 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:13.064035 (+ 339us) server_negotiation.cc:407] Connection header received
0812 00:00:13.064080 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:13.064082 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:13.064097 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:13.064167 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:13.064319 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.065141 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.066803 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.067398 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.067464 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.067518 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:13.068585 (+ 1067us) server_negotiation.cc:299] Negotiation successful
0812 00:00:13.068633 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":81,"threads_started":1}
I20260812 00:00:13.068565 29007 tablet_service.cc:1467] Processing CreateTablet for tablet 3455965efcd244bd90d5a215bf56e8d4 (DEFAULT_TABLE table=test-table [id=b581358489e74d33bbf3e038a71f2b1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:13.068825 29442 tablet_service.cc:1467] Processing CreateTablet for tablet 3455965efcd244bd90d5a215bf56e8d4 (DEFAULT_TABLE table=test-table [id=b581358489e74d33bbf3e038a71f2b1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:13.069015 29007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3455965efcd244bd90d5a215bf56e8d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:13.069118 29442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3455965efcd244bd90d5a215bf56e8d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:13.069255 29226 tablet_service.cc:1467] Processing CreateTablet for tablet 3455965efcd244bd90d5a215bf56e8d4 (DEFAULT_TABLE table=test-table [id=b581358489e74d33bbf3e038a71f2b1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:13.069605 29226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3455965efcd244bd90d5a215bf56e8d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:13.072409 29580 tablet_bootstrap.cc:492] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936: Bootstrap starting.
I20260812 00:00:13.072820 29586 tablet_bootstrap.cc:492] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e: Bootstrap starting.
I20260812 00:00:13.073096 29580 tablet_bootstrap.cc:654] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:13.073451 29580 log.cc:824] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:13.073657 29586 tablet_bootstrap.cc:654] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:13.073911 29586 log.cc:824] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:13.074108 29587 tablet_bootstrap.cc:492] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d: Bootstrap starting.
I20260812 00:00:13.074331 29580 tablet_bootstrap.cc:492] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936: No bootstrap required, opened a new log
I20260812 00:00:13.074393 29580 ts_tablet_manager.cc:1397] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:13.074719 29587 tablet_bootstrap.cc:654] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:13.074965 29586 tablet_bootstrap.cc:492] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e: No bootstrap required, opened a new log
I20260812 00:00:13.075027 29587 log.cc:824] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:13.075139 29586 ts_tablet_manager.cc:1397] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:00:13.075793 29587 tablet_bootstrap.cc:492] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d: No bootstrap required, opened a new log
I20260812 00:00:13.075867 29587 ts_tablet_manager.cc:1397] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:13.076455 29580 raft_consensus.cc:348] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.076651 29580 raft_consensus.cc:374] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:13.076689 29580 raft_consensus.cc:729] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7c95b21c2b24c55be9a1f3e55c72936, State: Initialized, Role: FOLLOWER
I20260812 00:00:13.076829 29580 consensus_queue.cc:260] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.077214 29580 ts_tablet_manager.cc:1428] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:00:13.077378 29331 heartbeater.cc:503] Master 127.25.103.126:41093 was elected leader, sending a full tablet report...
I20260812 00:00:13.077468 29586 raft_consensus.cc:348] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.077586 29586 raft_consensus.cc:374] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:13.077605 29586 raft_consensus.cc:729] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd5032985984df4af23751368a42d4e, State: Initialized, Role: FOLLOWER
I20260812 00:00:13.077688 29586 consensus_queue.cc:260] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.077936 29586 ts_tablet_manager.cc:1428] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:00:13.078087 29547 heartbeater.cc:503] Master 127.25.103.126:41093 was elected leader, sending a full tablet report...
I20260812 00:00:13.078111 29587 raft_consensus.cc:348] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.078258 29587 raft_consensus.cc:374] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:13.078293 29587 raft_consensus.cc:729] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fc817616be34ae59d8c2d8546c5537d, State: Initialized, Role: FOLLOWER
I20260812 00:00:13.078428 29587 consensus_queue.cc:260] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.078794 29587 ts_tablet_manager.cc:1428] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:00:13.078933 29103 heartbeater.cc:503] Master 127.25.103.126:41093 was elected leader, sending a full tablet report...
W20260812 00:00:13.115320 29332 tablet.cc:2369] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:00:13.192512 29104 tablet.cc:2369] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:00:13.230566 29593 raft_consensus.cc:482] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:00:13.230721 29593 raft_consensus.cc:504] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.231079 29593 leader_election.cc:288] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fc817616be34ae59d8c2d8546c5537d (127.25.103.65:40057), ccd5032985984df4af23751368a42d4e (127.25.103.67:35953)
I20260812 00:00:13.234026 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.231369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:53681 (local address 127.25.103.65:40057)
0812 00:00:13.231416 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:13.231417 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:13.231654 (+ 237us) server_negotiation.cc:407] Connection header received
0812 00:00:13.231692 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:13.231693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:13.231703 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:13.231755 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:13.231916 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.232406 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.233312 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.233661 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.233718 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.233727 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:13.233876 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 00:00:13.233925 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:00:13.234033 29577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.231400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:53005 (local address 127.25.103.67:35953)
0812 00:00:13.231450 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:13.231452 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:13.231497 (+ 45us) server_negotiation.cc:407] Connection header received
0812 00:00:13.231529 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:13.231530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:13.231540 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:13.231597 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:13.231757 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.232301 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.233299 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.233671 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.233737 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.233745 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:13.233895 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 00:00:13.233936 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:00:13.234041 29157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.231315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:35953 (local address 127.25.103.66:53005)
0812 00:00:13.231363 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:13.231375 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:13.231445 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:13.231607 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:13.231608 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:13.231610 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:13.231688 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.231690 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.232421 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.232422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.233208 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.233210 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.233748 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.233749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.233827 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.233830 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:00:13.233877 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 00:00:13.233924 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":4}
I20260812 00:00:13.234050 29597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.231318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:40057 (local address 127.25.103.66:53681)
0812 00:00:13.231578 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:13.231589 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:13.231648 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:13.231757 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:13.231758 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:13.231759 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:13.231822 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.231823 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.232495 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.232496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.233225 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.233227 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.233738 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.233739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.233813 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.233816 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:00:13.233858 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 00:00:13.233905 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"mutex_wait_us":65,"thread_start_us":110,"threads_started":1}
I20260812 00:00:13.234416 29038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3455965efcd244bd90d5a215bf56e8d4" candidate_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc817616be34ae59d8c2d8546c5537d" is_pre_election: true
I20260812 00:00:13.234416 29472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3455965efcd244bd90d5a215bf56e8d4" candidate_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd5032985984df4af23751368a42d4e" is_pre_election: true
I20260812 00:00:13.234579 29038 raft_consensus.cc:2454] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7c95b21c2b24c55be9a1f3e55c72936 in term 0.
I20260812 00:00:13.234579 29472 raft_consensus.cc:2454] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7c95b21c2b24c55be9a1f3e55c72936 in term 0.
I20260812 00:00:13.234819 29144 leader_election.cc:302] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fc817616be34ae59d8c2d8546c5537d, d7c95b21c2b24c55be9a1f3e55c72936; no voters:
I20260812 00:00:13.234946 29593 raft_consensus.cc:2781] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:00:13.235000 29593 raft_consensus.cc:482] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:00:13.235026 29593 raft_consensus.cc:3037] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:13.235998 29593 raft_consensus.cc:504] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.236130 29593 leader_election.cc:288] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [CANDIDATE]: Term 1 election: Requested vote from peers 3fc817616be34ae59d8c2d8546c5537d (127.25.103.65:40057), ccd5032985984df4af23751368a42d4e (127.25.103.67:35953)
I20260812 00:00:13.236282 29038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3455965efcd244bd90d5a215bf56e8d4" candidate_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc817616be34ae59d8c2d8546c5537d"
I20260812 00:00:13.236332 29472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3455965efcd244bd90d5a215bf56e8d4" candidate_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd5032985984df4af23751368a42d4e"
I20260812 00:00:13.236366 29038 raft_consensus.cc:3037] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:13.236408 29472 raft_consensus.cc:3037] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:13.237051 29038 raft_consensus.cc:2454] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7c95b21c2b24c55be9a1f3e55c72936 in term 1.
I20260812 00:00:13.237061 29472 raft_consensus.cc:2454] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7c95b21c2b24c55be9a1f3e55c72936 in term 1.
I20260812 00:00:13.237210 29144 leader_election.cc:302] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fc817616be34ae59d8c2d8546c5537d, d7c95b21c2b24c55be9a1f3e55c72936; no voters:
I20260812 00:00:13.237319 29593 raft_consensus.cc:2781] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:13.237490 29593 raft_consensus.cc:686] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 LEADER]: Becoming Leader. State: Replica: d7c95b21c2b24c55be9a1f3e55c72936, State: Running, Role: LEADER
I20260812 00:00:13.237583 29593 consensus_queue.cc:237] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.238564 28807 catalog_manager.cc:5495] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7c95b21c2b24c55be9a1f3e55c72936 (127.25.103.66). New cstate: current_term: 1 leader_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } health_report { overall_health: UNKNOWN } } }
W20260812 00:00:13.272545 29549 tablet.cc:2369] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 00:00:13 dist-test-slave-vpvm krb5kdc[28735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492812, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:13.281387 29609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.274760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:41093 (local address 127.0.0.1:34124)
0812 00:00:13.274921 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:13.274931 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:13.275006 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:13.275131 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:13.275132 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:13.275460 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:13.275526 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.275529 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.276167 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.276168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.276681 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.276682 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.276981 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.276982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.277029 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.277561 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:13.277566 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:13.279018 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:13.280373 (+ 1355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:13.280381 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:13.280384 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:13.280573 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:13.280741 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:13.280741 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:13.280742 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:13.280793 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:13.281030 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:13.281038 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:13.281088 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 00:00:13.281158 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 00:00:13.281279 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":82,"threads_started":1}
I20260812 00:00:13.281436 28876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.274842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34124 (local address 127.25.103.126:41093)
0812 00:00:13.274914 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:13.274916 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:13.274996 (+ 80us) server_negotiation.cc:407] Connection header received
0812 00:00:13.275061 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:13.275062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:13.275072 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:13.275120 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:13.275612 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.276098 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.276755 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.276926 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.276978 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.279102 (+ 2124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:13.279103 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:13.279103 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:13.279111 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:13.280297 (+ 1186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:13.280638 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:13.280639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:13.280639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:13.280688 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:13.280842 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:13.280843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:13.280843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:13.280948 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:13.281024 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:13.281234 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 00:00:13.281337 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":43}
I20260812 00:00:13.283398 28807 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:34124:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 00:00:13.283612 28807 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:00:13.285190 29007 tablet_service.cc:1467] Processing CreateTablet for tablet 6890ec8ba6904c729d7e5b13a659e9ed (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b91c5eb1f55a40d99292f500c86590ce]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:00:13.285177 29442 tablet_service.cc:1467] Processing CreateTablet for tablet 6890ec8ba6904c729d7e5b13a659e9ed (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b91c5eb1f55a40d99292f500c86590ce]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:00:13.285372 29007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6890ec8ba6904c729d7e5b13a659e9ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:13.285378 29442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6890ec8ba6904c729d7e5b13a659e9ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:13.286772 29586 tablet_bootstrap.cc:492] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e: Bootstrap starting.
I20260812 00:00:13.286983 29226 tablet_service.cc:1467] Processing CreateTablet for tablet 6890ec8ba6904c729d7e5b13a659e9ed (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b91c5eb1f55a40d99292f500c86590ce]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:00:13.287128 29226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6890ec8ba6904c729d7e5b13a659e9ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:13.287310 29586 tablet_bootstrap.cc:654] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:13.287933 29586 tablet_bootstrap.cc:492] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e: No bootstrap required, opened a new log
I20260812 00:00:13.287979 29586 ts_tablet_manager.cc:1397] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 00:00:13.288162 29586 raft_consensus.cc:348] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.288255 29586 raft_consensus.cc:374] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:13.288282 29586 raft_consensus.cc:729] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd5032985984df4af23751368a42d4e, State: Initialized, Role: FOLLOWER
I20260812 00:00:13.288265 29587 tablet_bootstrap.cc:492] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d: Bootstrap starting.
I20260812 00:00:13.288323 29586 consensus_queue.cc:260] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.288409 29586 ts_tablet_manager.cc:1428] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 00:00:13.288563 29595 tablet_replica.cc:439] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } } }
I20260812 00:00:13.288626 29595 tablet_replica.cc:442] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:13.288657 29587 tablet_bootstrap.cc:654] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:13.288937 29580 tablet_bootstrap.cc:492] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936: Bootstrap starting.
I20260812 00:00:13.289292 29580 tablet_bootstrap.cc:654] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:13.289342 29587 tablet_bootstrap.cc:492] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d: No bootstrap required, opened a new log
I20260812 00:00:13.289393 29587 ts_tablet_manager.cc:1397] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 00:00:13.289551 29587 raft_consensus.cc:348] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.289625 29587 raft_consensus.cc:374] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:13.289646 29587 raft_consensus.cc:729] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fc817616be34ae59d8c2d8546c5537d, State: Initialized, Role: FOLLOWER
I20260812 00:00:13.289680 29587 consensus_queue.cc:260] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.289788 29587 ts_tablet_manager.cc:1428] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 00:00:13.289920 29596 tablet_replica.cc:439] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } } }
I20260812 00:00:13.290030 29596 tablet_replica.cc:442] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:13.290400 29580 tablet_bootstrap.cc:492] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936: No bootstrap required, opened a new log
I20260812 00:00:13.290452 29580 ts_tablet_manager.cc:1397] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:13.290587 29580 raft_consensus.cc:348] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.290666 29580 raft_consensus.cc:374] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:13.290684 29580 raft_consensus.cc:729] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7c95b21c2b24c55be9a1f3e55c72936, State: Initialized, Role: FOLLOWER
I20260812 00:00:13.290729 29580 consensus_queue.cc:260] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.290817 29580 ts_tablet_manager.cc:1428] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:13.290863 29593 tablet_replica.cc:439] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } } }
I20260812 00:00:13.290946 29593 tablet_replica.cc:442] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:13.309181 29595 raft_consensus.cc:482] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:00:13.309327 29595 raft_consensus.cc:504] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.310052 29595 leader_election.cc:288] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fc817616be34ae59d8c2d8546c5537d (127.25.103.65:40057), d7c95b21c2b24c55be9a1f3e55c72936 (127.25.103.66:46489)
I20260812 00:00:13.313495 29578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.310402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:46421 (local address 127.25.103.66:46489)
0812 00:00:13.310530 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:13.310531 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:13.310541 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:00:13.310576 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:13.310577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:13.310585 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:13.310639 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:13.310852 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.311542 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.312704 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.313119 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.313194 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.313206 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:13.313367 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 00:00:13.313415 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 00:00:13.313506 29379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.310231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:46489 (local address 127.25.103.67:46421)
0812 00:00:13.310294 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:13.310313 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:13.310404 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:13.310668 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:13.310669 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:13.310672 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:13.310780 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.310783 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.311690 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.311692 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.312580 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.312583 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.313205 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.313206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.313299 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.313303 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:00:13.313352 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 00:00:13.313403 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 00:00:13.313898 29258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6890ec8ba6904c729d7e5b13a659e9ed" candidate_uuid: "ccd5032985984df4af23751368a42d4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" is_pre_election: true
I20260812 00:00:13.314073 29258 raft_consensus.cc:2454] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd5032985984df4af23751368a42d4e in term 0.
I20260812 00:00:13.314126 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.310412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:55101 (local address 127.25.103.65:40057)
0812 00:00:13.310510 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:13.310513 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:13.310682 (+ 169us) server_negotiation.cc:407] Connection header received
0812 00:00:13.310752 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:13.310754 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:13.310763 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:13.310806 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:13.310991 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.311488 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.312780 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.313387 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.313510 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.313521 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:13.313974 (+ 453us) server_negotiation.cc:299] Negotiation successful
0812 00:00:13.314054 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 00:00:13.314109 29618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.310231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:40057 (local address 127.25.103.67:55101)
0812 00:00:13.310591 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:13.310602 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:13.310679 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:13.310822 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:13.310823 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:13.310825 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:13.310924 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.310926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.311570 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.311571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.312579 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.312583 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.313510 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.313512 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.313783 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.313796 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 00:00:13.313891 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 00:00:13.313983 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":70,"thread_start_us":144,"threads_started":1}
I20260812 00:00:13.314307 29371 leader_election.cc:302] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd5032985984df4af23751368a42d4e, d7c95b21c2b24c55be9a1f3e55c72936; no voters:
I20260812 00:00:13.314553 29595 raft_consensus.cc:2781] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:00:13.314541 29038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6890ec8ba6904c729d7e5b13a659e9ed" candidate_uuid: "ccd5032985984df4af23751368a42d4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc817616be34ae59d8c2d8546c5537d" is_pre_election: true
I20260812 00:00:13.314618 29595 raft_consensus.cc:482] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:00:13.314638 29038 raft_consensus.cc:2454] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd5032985984df4af23751368a42d4e in term 0.
I20260812 00:00:13.314651 29595 raft_consensus.cc:3037] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:13.315620 29595 raft_consensus.cc:504] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.315814 29595 leader_election.cc:288] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [CANDIDATE]: Term 1 election: Requested vote from peers 3fc817616be34ae59d8c2d8546c5537d (127.25.103.65:40057), d7c95b21c2b24c55be9a1f3e55c72936 (127.25.103.66:46489)
I20260812 00:00:13.316036 29038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6890ec8ba6904c729d7e5b13a659e9ed" candidate_uuid: "ccd5032985984df4af23751368a42d4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc817616be34ae59d8c2d8546c5537d"
I20260812 00:00:13.316150 29038 raft_consensus.cc:3037] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:13.316182 29258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6890ec8ba6904c729d7e5b13a659e9ed" candidate_uuid: "ccd5032985984df4af23751368a42d4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7c95b21c2b24c55be9a1f3e55c72936"
I20260812 00:00:13.316339 29258 raft_consensus.cc:3037] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:13.317469 29038 raft_consensus.cc:2454] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd5032985984df4af23751368a42d4e in term 1.
I20260812 00:00:13.317469 29258 raft_consensus.cc:2454] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd5032985984df4af23751368a42d4e in term 1.
I20260812 00:00:13.317889 29371 leader_election.cc:302] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd5032985984df4af23751368a42d4e, d7c95b21c2b24c55be9a1f3e55c72936; no voters:
I20260812 00:00:13.318094 29595 raft_consensus.cc:2781] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:13.318428 29595 raft_consensus.cc:686] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [term 1 LEADER]: Becoming Leader. State: Replica: ccd5032985984df4af23751368a42d4e, State: Running, Role: LEADER
I20260812 00:00:13.318573 29595 consensus_queue.cc:237] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.319125 29619 tablet_replica.cc:439] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e: TxnStatusTablet state changed. Reason: New leader ccd5032985984df4af23751368a42d4e. Latest consensus state: current_term: 1 leader_uuid: "ccd5032985984df4af23751368a42d4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } } }
I20260812 00:00:13.319197 29619 tablet_replica.cc:442] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:00:13.319358 29621 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 00:00:13.319463 29621 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 00:00:13.319653 28808 catalog_manager.cc:5495] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd5032985984df4af23751368a42d4e (127.25.103.67). New cstate: current_term: 1 leader_uuid: "ccd5032985984df4af23751368a42d4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } health_report { overall_health: HEALTHY } } }
I20260812 00:00:13.328392 29577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.325885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36862 (local address 127.25.103.67:35953)
0812 00:00:13.325973 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:13.325975 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:13.325985 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:00:13.326072 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:13.326073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:13.326095 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:13.326153 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:13.326293 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.326808 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.327579 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.327777 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.327835 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.328034 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:13.328146 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:13.328223 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:13.328271 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 00:00:13.328299 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 00:00:13.328397 29609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.325816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:35953 (local address 127.0.0.1:36862)
0812 00:00:13.325903 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:13.325914 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:13.325994 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:13.326172 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:13.326173 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:13.326174 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:00:13.326234 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.326237 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.326900 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.326901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.327492 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.327494 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.327855 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.327856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.327926 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.327945 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:00:13.328214 (+ 269us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:00:13.328223 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 00:00:13.328268 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 00:00:13.328325 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 00:00:13.330580 29038 raft_consensus.cc:1261] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d [term 1 FOLLOWER]: Refusing update from remote peer ccd5032985984df4af23751368a42d4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:13.330570 29258 raft_consensus.cc:1261] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 FOLLOWER]: Refusing update from remote peer ccd5032985984df4af23751368a42d4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:13.331069 29595 consensus_queue.cc:1035] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:13.331223 29619 consensus_queue.cc:1035] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:13.332633 29593 tablet_replica.cc:439] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936: TxnStatusTablet state changed. Reason: New leader ccd5032985984df4af23751368a42d4e. Latest consensus state: current_term: 1 leader_uuid: "ccd5032985984df4af23751368a42d4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } } }
I20260812 00:00:13.332744 29593 tablet_replica.cc:442] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:13.332683 29596 tablet_replica.cc:439] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d: TxnStatusTablet state changed. Reason: New leader ccd5032985984df4af23751368a42d4e. Latest consensus state: current_term: 1 leader_uuid: "ccd5032985984df4af23751368a42d4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } } }
I20260812 00:00:13.332861 29596 tablet_replica.cc:442] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:13.339195 29595 tablet_replica.cc:439] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ccd5032985984df4af23751368a42d4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } } }
I20260812 00:00:13.339330 29595 tablet_replica.cc:442] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:00:13.339401 29625 mvcc.cc:205] Tried to move back new op lower bound from 7317474563398844416 to 7317474563353612288. Current Snapshot: MvccSnapshot[applied={T|T < 7317474563398844416}]
I20260812 00:00:13.339368 29619 tablet_replica.cc:439] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ccd5032985984df4af23751368a42d4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } } }
I20260812 00:00:13.339395 29593 tablet_replica.cc:439] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ccd5032985984df4af23751368a42d4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } } }
I20260812 00:00:13.339462 29619 tablet_replica.cc:442] T 6890ec8ba6904c729d7e5b13a659e9ed P ccd5032985984df4af23751368a42d4e: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:00:13.339483 29593 tablet_replica.cc:442] T 6890ec8ba6904c729d7e5b13a659e9ed P d7c95b21c2b24c55be9a1f3e55c72936: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:13.340044 29629 mvcc.cc:205] Tried to move back new op lower bound from 7317474563398844416 to 7317474563353612288. Current Snapshot: MvccSnapshot[applied={T|T < 7317474563398844416}]
I20260812 00:00:13.340233 29596 tablet_replica.cc:439] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ccd5032985984df4af23751368a42d4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } } }
I20260812 00:00:13.340349 29596 tablet_replica.cc:442] T 6890ec8ba6904c729d7e5b13a659e9ed P 3fc817616be34ae59d8c2d8546c5537d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:13.340626 29626 mvcc.cc:205] Tried to move back new op lower bound from 7317474563398844416 to 7317474563353612288. Current Snapshot: MvccSnapshot[applied={T|T < 7317474563398844416}]
I20260812 00:00:13.345587 29578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.342749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34318 (local address 127.25.103.66:46489)
0812 00:00:13.342856 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:13.342859 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:13.342871 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:00:13.342922 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:13.342923 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:13.342947 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:13.343031 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:13.343328 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.343963 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.344796 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.345013 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.345073 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.345232 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:13.345359 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:13.345434 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:13.345473 (+ 39us) server_negotiation.cc:299] Negotiation successful
0812 00:00:13.345499 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 00:00:13.352701 29577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.349608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:55121 (local address 127.25.103.67:35953)
0812 00:00:13.349720 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:13.349722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:13.349739 (+ 17us) server_negotiation.cc:407] Connection header received
0812 00:00:13.349880 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:13.349881 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:13.349892 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:13.350016 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:13.350226 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.350740 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.351876 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.352079 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.352146 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.352404 (+ 258us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:13.352440 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:13.352537 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:13.352603 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 00:00:13.352629 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 00:00:13.352734 29341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.349584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:35953 (local address 127.25.103.66:55121)
0812 00:00:13.349684 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:13.349698 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:13.349760 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:13.350027 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:13.350028 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:13.350029 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:00:13.350113 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.350115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.350813 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.350813 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.351763 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.351765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.352164 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.352164 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.352236 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.352262 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:00:13.352543 (+ 281us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:00:13.352545 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:00:13.352596 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:00:13.352648 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 00:00:13.355867 29038 raft_consensus.cc:1261] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d [term 1 FOLLOWER]: Refusing update from remote peer d7c95b21c2b24c55be9a1f3e55c72936: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:13.355932 29472 raft_consensus.cc:1261] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e [term 1 FOLLOWER]: Refusing update from remote peer d7c95b21c2b24c55be9a1f3e55c72936: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:13.356156 29599 consensus_queue.cc:1035] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:13.356302 29593 consensus_queue.cc:1035] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:13.366650 29578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.364151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:54665 (local address 127.25.103.66:46489)
0812 00:00:13.364194 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:13.364196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:13.364205 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:13.364267 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:13.364269 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:13.364280 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:13.364326 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:13.364477 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.364972 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.365894 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.366158 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.366218 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.366391 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:13.366430 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:13.366473 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:13.366538 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 00:00:13.366563 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:00:13.366650 29556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.364062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:46489 (local address 127.25.103.67:54665)
0812 00:00:13.364155 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:13.364166 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:13.364209 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:13.364345 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:13.364346 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:13.364347 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:00:13.364421 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.364423 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.365077 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.365078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.365817 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.365820 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.366228 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.366229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.366301 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.366319 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:00:13.366487 (+ 168us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:00:13.366489 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:00:13.366525 (+ 36us) client_negotiation.cc:240] Negotiation successful
0812 00:00:13.366574 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260812 00:00:13.377111 28807 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:13.377249 28807 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:13.378125 28807 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32: Sending DeleteTablet for 3 replicas of tablet 3455965efcd244bd90d5a215bf56e8d4
I20260812 00:00:13.378573 29007 tablet_service.cc:1514] Processing DeleteTablet for tablet 3455965efcd244bd90d5a215bf56e8d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:13 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:57306
I20260812 00:00:13.378877 29226 tablet_service.cc:1514] Processing DeleteTablet for tablet 3455965efcd244bd90d5a215bf56e8d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:13 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:34316
I20260812 00:00:13.379096 29654 tablet_replica.cc:330] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936: stopping tablet replica
I20260812 00:00:13.379228 29654 raft_consensus.cc:2229] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:00:13.379351 29654 raft_consensus.cc:2258] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:13.379451 29442 tablet_service.cc:1514] Processing DeleteTablet for tablet 3455965efcd244bd90d5a215bf56e8d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:13 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:36858
I20260812 00:00:13.379918 29654 ts_tablet_manager.cc:1905] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:13.380122 28807 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34108:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:00:13.380292 28807 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:00:13.381928 29226 tablet_service.cc:1467] Processing CreateTablet for tablet cd5a04f102b4491cac61baa3f5ec4fdb (DEFAULT_TABLE table=test-table [id=94822e4f950b4168991f01a81a4b1488]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:13.382102 29226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd5a04f102b4491cac61baa3f5ec4fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:13.382812 29654 ts_tablet_manager.cc:1918] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:00:13.382893 29654 log.cc:1196] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/3455965efcd244bd90d5a215bf56e8d4
I20260812 00:00:13.383214 29654 ts_tablet_manager.cc:1939] T 3455965efcd244bd90d5a215bf56e8d4 P d7c95b21c2b24c55be9a1f3e55c72936: Deleting consensus metadata
I20260812 00:00:13.383486 29580 tablet_bootstrap.cc:492] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936: Bootstrap starting.
I20260812 00:00:13.383903 29580 tablet_bootstrap.cc:654] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:13.384423 29007 tablet_service.cc:1467] Processing CreateTablet for tablet cd5a04f102b4491cac61baa3f5ec4fdb (DEFAULT_TABLE table=test-table [id=94822e4f950b4168991f01a81a4b1488]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:13.384562 29007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd5a04f102b4491cac61baa3f5ec4fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:13.385116 29580 tablet_bootstrap.cc:492] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936: No bootstrap required, opened a new log
I20260812 00:00:13.385201 29580 ts_tablet_manager.cc:1397] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:13.385401 29580 raft_consensus.cc:348] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.385496 29580 raft_consensus.cc:374] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:13.385517 29580 raft_consensus.cc:729] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7c95b21c2b24c55be9a1f3e55c72936, State: Initialized, Role: FOLLOWER
I20260812 00:00:13.385577 29580 consensus_queue.cc:260] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.385697 29580 ts_tablet_manager.cc:1428] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:00:13.386076 29587 tablet_bootstrap.cc:492] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d: Bootstrap starting.
I20260812 00:00:13.386415 28789 catalog_manager.cc:4841] TS d7c95b21c2b24c55be9a1f3e55c72936 (127.25.103.66:46489): tablet 3455965efcd244bd90d5a215bf56e8d4 (table test-table [id=b581358489e74d33bbf3e038a71f2b1e]) successfully deleted
I20260812 00:00:13.387130 29587 tablet_bootstrap.cc:654] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:13.387154 29442 tablet_service.cc:1467] Processing CreateTablet for tablet cd5a04f102b4491cac61baa3f5ec4fdb (DEFAULT_TABLE table=test-table [id=94822e4f950b4168991f01a81a4b1488]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:13.387300 29442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd5a04f102b4491cac61baa3f5ec4fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:13.387982 29587 tablet_bootstrap.cc:492] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d: No bootstrap required, opened a new log
I20260812 00:00:13.388031 29587 ts_tablet_manager.cc:1397] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:00:13.388207 29587 raft_consensus.cc:348] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.388306 29587 raft_consensus.cc:374] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:13.388327 29587 raft_consensus.cc:729] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fc817616be34ae59d8c2d8546c5537d, State: Initialized, Role: FOLLOWER
I20260812 00:00:13.388381 29587 consensus_queue.cc:260] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.388471 29587 ts_tablet_manager.cc:1428] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 00:00:13.388890 29586 tablet_bootstrap.cc:492] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e: Bootstrap starting.
I20260812 00:00:13.389315 29586 tablet_bootstrap.cc:654] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:13.390390 29586 tablet_bootstrap.cc:492] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e: No bootstrap required, opened a new log
I20260812 00:00:13.390460 29586 ts_tablet_manager.cc:1397] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:00:13.390650 29586 raft_consensus.cc:348] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.390739 29586 raft_consensus.cc:374] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:13.390759 29586 raft_consensus.cc:729] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd5032985984df4af23751368a42d4e, State: Initialized, Role: FOLLOWER
I20260812 00:00:13.390821 29586 consensus_queue.cc:260] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.390939 29586 ts_tablet_manager.cc:1428] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:13.391114 29656 tablet_replica.cc:330] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e: stopping tablet replica
I20260812 00:00:13.391278 29652 tablet_replica.cc:330] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d: stopping tablet replica
I20260812 00:00:13.391469 29652 raft_consensus.cc:2229] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:13.391614 29656 raft_consensus.cc:2229] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:13.391721 29656 raft_consensus.cc:2258] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:13.391814 29652 raft_consensus.cc:2258] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:13.392719 29656 ts_tablet_manager.cc:1905] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:13.393298 29652 ts_tablet_manager.cc:1905] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:13.397699 29656 ts_tablet_manager.cc:1918] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:00:13.398036 29652 ts_tablet_manager.cc:1918] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:00:13.398204 29656 log.cc:1196] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/3455965efcd244bd90d5a215bf56e8d4
I20260812 00:00:13.398320 29652 log.cc:1196] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/wal/wals/3455965efcd244bd90d5a215bf56e8d4
I20260812 00:00:13.398660 29656 ts_tablet_manager.cc:1939] T 3455965efcd244bd90d5a215bf56e8d4 P ccd5032985984df4af23751368a42d4e: Deleting consensus metadata
I20260812 00:00:13.398958 29652 ts_tablet_manager.cc:1939] T 3455965efcd244bd90d5a215bf56e8d4 P 3fc817616be34ae59d8c2d8546c5537d: Deleting consensus metadata
I20260812 00:00:13.399515 28784 catalog_manager.cc:4841] TS ccd5032985984df4af23751368a42d4e (127.25.103.67:35953): tablet 3455965efcd244bd90d5a215bf56e8d4 (table test-table [id=b581358489e74d33bbf3e038a71f2b1e]) successfully deleted
I20260812 00:00:13.399991 28783 catalog_manager.cc:4841] TS 3fc817616be34ae59d8c2d8546c5537d (127.25.103.65:40057): tablet 3455965efcd244bd90d5a215bf56e8d4 (table test-table [id=b581358489e74d33bbf3e038a71f2b1e]) successfully deleted
I20260812 00:00:13.589404 29595 raft_consensus.cc:482] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:00:13.589556 29595 raft_consensus.cc:504] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.589725 29595 leader_election.cc:288] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fc817616be34ae59d8c2d8546c5537d (127.25.103.65:40057), d7c95b21c2b24c55be9a1f3e55c72936 (127.25.103.66:46489)
I20260812 00:00:13.590098 29258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5a04f102b4491cac61baa3f5ec4fdb" candidate_uuid: "ccd5032985984df4af23751368a42d4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" is_pre_election: true
I20260812 00:00:13.590199 29258 raft_consensus.cc:2454] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd5032985984df4af23751368a42d4e in term 0.
I20260812 00:00:13.590150 29038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5a04f102b4491cac61baa3f5ec4fdb" candidate_uuid: "ccd5032985984df4af23751368a42d4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc817616be34ae59d8c2d8546c5537d" is_pre_election: true
I20260812 00:00:13.590248 29038 raft_consensus.cc:2454] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd5032985984df4af23751368a42d4e in term 0.
I20260812 00:00:13.590371 29371 leader_election.cc:302] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd5032985984df4af23751368a42d4e, d7c95b21c2b24c55be9a1f3e55c72936; no voters:
I20260812 00:00:13.590464 29595 raft_consensus.cc:2781] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:00:13.590504 29595 raft_consensus.cc:482] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:00:13.590523 29595 raft_consensus.cc:3037] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:13.591290 29595 raft_consensus.cc:504] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.591439 29595 leader_election.cc:288] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [CANDIDATE]: Term 1 election: Requested vote from peers 3fc817616be34ae59d8c2d8546c5537d (127.25.103.65:40057), d7c95b21c2b24c55be9a1f3e55c72936 (127.25.103.66:46489)
I20260812 00:00:13.591686 29258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5a04f102b4491cac61baa3f5ec4fdb" candidate_uuid: "ccd5032985984df4af23751368a42d4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7c95b21c2b24c55be9a1f3e55c72936"
I20260812 00:00:13.591776 29258 raft_consensus.cc:3037] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:13.591776 29038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5a04f102b4491cac61baa3f5ec4fdb" candidate_uuid: "ccd5032985984df4af23751368a42d4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc817616be34ae59d8c2d8546c5537d"
I20260812 00:00:13.591877 29038 raft_consensus.cc:3037] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:13.592504 29258 raft_consensus.cc:2454] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd5032985984df4af23751368a42d4e in term 1.
I20260812 00:00:13.592564 29038 raft_consensus.cc:2454] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd5032985984df4af23751368a42d4e in term 1.
I20260812 00:00:13.592689 29371 leader_election.cc:302] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd5032985984df4af23751368a42d4e, d7c95b21c2b24c55be9a1f3e55c72936; no voters:
I20260812 00:00:13.592803 29595 raft_consensus.cc:2781] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:13.592849 29595 raft_consensus.cc:686] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [term 1 LEADER]: Becoming Leader. State: Replica: ccd5032985984df4af23751368a42d4e, State: Running, Role: LEADER
I20260812 00:00:13.592901 29595 consensus_queue.cc:237] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:13.593523 28807 catalog_manager.cc:5495] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd5032985984df4af23751368a42d4e (127.25.103.67). New cstate: current_term: 1 leader_uuid: "ccd5032985984df4af23751368a42d4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } health_report { overall_health: HEALTHY } } }
I20260812 00:00:13.630231 29577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.627238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36878 (local address 127.25.103.67:35953)
0812 00:00:13.627343 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:13.627345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:13.627356 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:00:13.627386 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:13.627386 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:13.627397 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:13.627459 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:13.627654 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.628180 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.629114 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.629359 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.629437 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.629713 (+ 276us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:13.629760 (+ 47us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:13.629824 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:13.630070 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 00:00:13.630112 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 00:00:13.636119 29577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.633660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:51563 (local address 127.25.103.67:35953)
0812 00:00:13.633717 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:13.633719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:13.633729 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:00:13.633751 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:13.633752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:13.633763 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:13.633829 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:13.634061 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.634590 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.635493 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.635696 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.635765 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.635888 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:13.635928 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:13.635960 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:13.636022 (+ 62us) server_negotiation.cc:299] Negotiation successful
0812 00:00:13.636039 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:00:13.636123 29556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:13.633507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:35953 (local address 127.25.103.67:51563)
0812 00:00:13.633578 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:13.633590 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:13.633627 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:13.633875 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:13.633877 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:13.633878 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:00:13.633932 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.633933 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.634724 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.634725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.635355 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:13.635357 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:13.635782 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:13.635782 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:13.635826 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:13.635832 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:00:13.635968 (+ 136us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:00:13.635969 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 00:00:13.636017 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 00:00:13.636059 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 00:00:13.639132 29038 raft_consensus.cc:1261] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d [term 1 FOLLOWER]: Refusing update from remote peer ccd5032985984df4af23751368a42d4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:13.639132 29258 raft_consensus.cc:1261] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 FOLLOWER]: Refusing update from remote peer ccd5032985984df4af23751368a42d4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:13.639422 29619 consensus_queue.cc:1035] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:13.639565 29595 consensus_queue.cc:1035] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 00:00:13.644903 29625 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 00:00:15.169174 28806 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:15.169306 28806 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:15.170451 28806 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32: Sending DeleteTablet for 3 replicas of tablet cd5a04f102b4491cac61baa3f5ec4fdb
I20260812 00:00:15.170794 29442 tablet_service.cc:1514] Processing DeleteTablet for tablet cd5a04f102b4491cac61baa3f5ec4fdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:15 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:36858
I20260812 00:00:15.170809 29007 tablet_service.cc:1514] Processing DeleteTablet for tablet cd5a04f102b4491cac61baa3f5ec4fdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:15 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:57306
I20260812 00:00:15.170842 29226 tablet_service.cc:1514] Processing DeleteTablet for tablet cd5a04f102b4491cac61baa3f5ec4fdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:15 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:34316
I20260812 00:00:15.173785 29702 tablet_replica.cc:330] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936: stopping tablet replica
I20260812 00:00:15.173887 29702 raft_consensus.cc:2229] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:15.173938 29702 raft_consensus.cc:2258] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:15.174121 29700 tablet_replica.cc:330] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e: stopping tablet replica
I20260812 00:00:15.174216 29700 raft_consensus.cc:2229] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:00:15.174325 29702 ts_tablet_manager.cc:1905] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:15.174341 29700 raft_consensus.cc:2258] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:15.174491 29701 tablet_replica.cc:330] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d: stopping tablet replica
I20260812 00:00:15.174567 29701 raft_consensus.cc:2229] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:15.174616 29701 raft_consensus.cc:2258] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:15.174660 29700 ts_tablet_manager.cc:1905] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:15.174858 29701 ts_tablet_manager.cc:1905] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:15.176326 29702 ts_tablet_manager.cc:1918] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:00:15.176338 29700 ts_tablet_manager.cc:1918] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:00:15.176414 29702 log.cc:1196] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/cd5a04f102b4491cac61baa3f5ec4fdb
I20260812 00:00:15.176497 29701 ts_tablet_manager.cc:1918] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:00:15.176559 29701 log.cc:1196] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/wal/wals/cd5a04f102b4491cac61baa3f5ec4fdb
I20260812 00:00:15.176524 29700 log.cc:1196] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/cd5a04f102b4491cac61baa3f5ec4fdb
I20260812 00:00:15.176659 29702 ts_tablet_manager.cc:1939] T cd5a04f102b4491cac61baa3f5ec4fdb P d7c95b21c2b24c55be9a1f3e55c72936: Deleting consensus metadata
I20260812 00:00:15.176785 29701 ts_tablet_manager.cc:1939] T cd5a04f102b4491cac61baa3f5ec4fdb P 3fc817616be34ae59d8c2d8546c5537d: Deleting consensus metadata
I20260812 00:00:15.176954 29700 ts_tablet_manager.cc:1939] T cd5a04f102b4491cac61baa3f5ec4fdb P ccd5032985984df4af23751368a42d4e: Deleting consensus metadata
I20260812 00:00:15.177120 28789 catalog_manager.cc:4841] TS d7c95b21c2b24c55be9a1f3e55c72936 (127.25.103.66:46489): tablet cd5a04f102b4491cac61baa3f5ec4fdb (table test-table [id=94822e4f950b4168991f01a81a4b1488]) successfully deleted
I20260812 00:00:15.177132 28783 catalog_manager.cc:4841] TS 3fc817616be34ae59d8c2d8546c5537d (127.25.103.65:40057): tablet cd5a04f102b4491cac61baa3f5ec4fdb (table test-table [id=94822e4f950b4168991f01a81a4b1488]) successfully deleted
I20260812 00:00:15.177276 28784 catalog_manager.cc:4841] TS ccd5032985984df4af23751368a42d4e (127.25.103.67:35953): tablet cd5a04f102b4491cac61baa3f5ec4fdb (table test-table [id=94822e4f950b4168991f01a81a4b1488]) successfully deleted
Aug 12 00:00:15 dist-test-slave-vpvm krb5kdc[28735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492815, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:00:15 dist-test-slave-vpvm krb5kdc[28735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492815, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:15.204445 29715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:15.193638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34132 (local address 127.25.103.126:41093)
0812 00:00:15.193809 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:15.193810 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:15.193821 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:00:15.193850 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:15.193851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:15.193862 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:15.194042 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:15.194965 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.195561 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.196513 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.196915 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.197012 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:15.200605 (+ 3593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:15.200608 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:15.200609 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:15.200622 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:15.202507 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:15.203042 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:15.203044 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:15.203044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:15.203263 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:15.203564 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:15.203565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:15.203565 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:15.203742 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:15.203864 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:15.204213 (+ 349us) server_negotiation.cc:299] Negotiation successful
0812 00:00:15.204330 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":109,"threads_started":1}
I20260812 00:00:15.206681 28806 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34132:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:00:15.206871 28806 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:00:15.209072 29007 tablet_service.cc:1467] Processing CreateTablet for tablet f0d4f36962184edabc3346e942e08ac3 (DEFAULT_TABLE table=test-table [id=4e65b51a957a47639ab0b36001409074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:15.209050 29226 tablet_service.cc:1467] Processing CreateTablet for tablet f0d4f36962184edabc3346e942e08ac3 (DEFAULT_TABLE table=test-table [id=4e65b51a957a47639ab0b36001409074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:15.209074 29442 tablet_service.cc:1467] Processing CreateTablet for tablet f0d4f36962184edabc3346e942e08ac3 (DEFAULT_TABLE table=test-table [id=4e65b51a957a47639ab0b36001409074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:15.209280 29442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0d4f36962184edabc3346e942e08ac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:15.209280 29007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0d4f36962184edabc3346e942e08ac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:15.209296 29226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0d4f36962184edabc3346e942e08ac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:15.210608 29716 tablet_bootstrap.cc:492] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d: Bootstrap starting.
I20260812 00:00:15.211088 29716 tablet_bootstrap.cc:654] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:15.211385 29718 tablet_bootstrap.cc:492] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936: Bootstrap starting.
I20260812 00:00:15.211798 29718 tablet_bootstrap.cc:654] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:15.212054 29716 tablet_bootstrap.cc:492] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d: No bootstrap required, opened a new log
I20260812 00:00:15.212121 29716 ts_tablet_manager.cc:1397] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:15.212188 29717 tablet_bootstrap.cc:492] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e: Bootstrap starting.
I20260812 00:00:15.212277 29716 raft_consensus.cc:348] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:15.212365 29716 raft_consensus.cc:374] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:15.212389 29716 raft_consensus.cc:729] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fc817616be34ae59d8c2d8546c5537d, State: Initialized, Role: FOLLOWER
I20260812 00:00:15.212440 29716 consensus_queue.cc:260] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:15.212592 29717 tablet_bootstrap.cc:654] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:15.212615 29716 ts_tablet_manager.cc:1428] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:00:15.213049 29718 tablet_bootstrap.cc:492] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936: No bootstrap required, opened a new log
I20260812 00:00:15.213104 29718 ts_tablet_manager.cc:1397] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:15.213240 29718 raft_consensus.cc:348] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:15.213330 29718 raft_consensus.cc:374] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:15.213352 29718 raft_consensus.cc:729] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7c95b21c2b24c55be9a1f3e55c72936, State: Initialized, Role: FOLLOWER
I20260812 00:00:15.213405 29718 consensus_queue.cc:260] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:15.213605 29718 ts_tablet_manager.cc:1428] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:00:15.213853 29717 tablet_bootstrap.cc:492] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e: No bootstrap required, opened a new log
I20260812 00:00:15.213910 29717 ts_tablet_manager.cc:1397] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:15.214061 29717 raft_consensus.cc:348] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:15.214154 29717 raft_consensus.cc:374] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:15.214174 29717 raft_consensus.cc:729] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd5032985984df4af23751368a42d4e, State: Initialized, Role: FOLLOWER
I20260812 00:00:15.214247 29717 consensus_queue.cc:260] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:15.214352 29717 ts_tablet_manager.cc:1428] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:00:15.401571 29723 raft_consensus.cc:482] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:00:15.401695 29723 raft_consensus.cc:504] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:15.402102 29723 leader_election.cc:288] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7c95b21c2b24c55be9a1f3e55c72936 (127.25.103.66:46489), ccd5032985984df4af23751368a42d4e (127.25.103.67:35953)
I20260812 00:00:15.407382 29728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:15.402463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:36333 (local address 127.25.103.67:35953)
0812 00:00:15.402665 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:15.402668 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:15.402953 (+ 285us) server_negotiation.cc:407] Connection header received
0812 00:00:15.403040 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:15.403041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:15.403053 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:15.403168 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:15.403605 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.404539 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.406391 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.406961 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.407041 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:15.407048 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:15.407223 (+ 175us) server_negotiation.cc:299] Negotiation successful
0812 00:00:15.407287 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":131,"threads_started":1}
I20260812 00:00:15.407382 29729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:15.402469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:52127 (local address 127.25.103.66:46489)
0812 00:00:15.402665 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:15.402668 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:15.402932 (+ 264us) server_negotiation.cc:407] Connection header received
0812 00:00:15.403040 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:15.403041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:15.403053 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:15.403168 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:15.403606 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.404519 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.406277 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.406884 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.406980 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:15.406992 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:15.407238 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 00:00:15.407296 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":128,"threads_started":1}
I20260812 00:00:15.407619 29727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:15.402323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:35953 (local address 127.25.103.65:36333)
0812 00:00:15.402803 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:15.402856 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:15.402967 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:15.403223 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:15.403224 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:15.403229 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:15.403455 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:15.403457 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.404667 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.404669 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:15.406290 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:15.406292 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.407060 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.407060 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:15.407119 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:15.407122 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:00:15.407183 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 00:00:15.407399 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"mutex_wait_us":57,"thread_start_us":253,"threads_started":1}
I20260812 00:00:15.407626 29726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:15.402323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:46489 (local address 127.25.103.65:52127)
0812 00:00:15.402716 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:15.402735 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:15.402968 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:15.403222 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:15.403224 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:15.403230 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:15.403427 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:15.403434 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.404667 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.404669 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:15.406106 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:15.406111 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.407011 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.407012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:15.407108 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:15.407114 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:00:15.407252 (+ 138us) client_negotiation.cc:240] Negotiation successful
0812 00:00:15.407403 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":65,"thread_start_us":255,"threads_started":1}
I20260812 00:00:15.408103 29258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0d4f36962184edabc3346e942e08ac3" candidate_uuid: "3fc817616be34ae59d8c2d8546c5537d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" is_pre_election: true
I20260812 00:00:15.408159 29472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0d4f36962184edabc3346e942e08ac3" candidate_uuid: "3fc817616be34ae59d8c2d8546c5537d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd5032985984df4af23751368a42d4e" is_pre_election: true
I20260812 00:00:15.408217 29258 raft_consensus.cc:2454] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fc817616be34ae59d8c2d8546c5537d in term 0.
I20260812 00:00:15.408244 29472 raft_consensus.cc:2454] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fc817616be34ae59d8c2d8546c5537d in term 0.
I20260812 00:00:15.408469 28942 leader_election.cc:302] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fc817616be34ae59d8c2d8546c5537d, ccd5032985984df4af23751368a42d4e; no voters:
I20260812 00:00:15.408653 29723 raft_consensus.cc:2781] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:00:15.408694 29723 raft_consensus.cc:482] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:00:15.408707 29723 raft_consensus.cc:3037] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:15.409540 29723 raft_consensus.cc:504] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:15.409686 29723 leader_election.cc:288] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [CANDIDATE]: Term 1 election: Requested vote from peers d7c95b21c2b24c55be9a1f3e55c72936 (127.25.103.66:46489), ccd5032985984df4af23751368a42d4e (127.25.103.67:35953)
I20260812 00:00:15.409875 29472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0d4f36962184edabc3346e942e08ac3" candidate_uuid: "3fc817616be34ae59d8c2d8546c5537d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd5032985984df4af23751368a42d4e"
I20260812 00:00:15.409979 29472 raft_consensus.cc:3037] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:15.409914 29258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0d4f36962184edabc3346e942e08ac3" candidate_uuid: "3fc817616be34ae59d8c2d8546c5537d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7c95b21c2b24c55be9a1f3e55c72936"
I20260812 00:00:15.410029 29258 raft_consensus.cc:3037] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:15.410883 29472 raft_consensus.cc:2454] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fc817616be34ae59d8c2d8546c5537d in term 1.
I20260812 00:00:15.410893 29258 raft_consensus.cc:2454] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fc817616be34ae59d8c2d8546c5537d in term 1.
I20260812 00:00:15.411123 28944 leader_election.cc:302] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fc817616be34ae59d8c2d8546c5537d, d7c95b21c2b24c55be9a1f3e55c72936; no voters:
I20260812 00:00:15.411281 29723 raft_consensus.cc:2781] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:15.411564 29723 raft_consensus.cc:686] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [term 1 LEADER]: Becoming Leader. State: Replica: 3fc817616be34ae59d8c2d8546c5537d, State: Running, Role: LEADER
I20260812 00:00:15.411657 29723 consensus_queue.cc:237] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:15.412604 28806 catalog_manager.cc:5495] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fc817616be34ae59d8c2d8546c5537d (127.25.103.65). New cstate: current_term: 1 leader_uuid: "3fc817616be34ae59d8c2d8546c5537d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } health_report { overall_health: UNKNOWN } } }
I20260812 00:00:15.450160 29738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:15.447457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57314 (local address 127.25.103.65:40057)
0812 00:00:15.447655 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:15.447657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:15.447666 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:15.447710 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:15.447711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:15.447734 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:15.447827 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:15.447945 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.448447 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.449353 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.449583 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.449640 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:15.449805 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:15.449923 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:15.449999 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:15.450028 (+ 29us) server_negotiation.cc:299] Negotiation successful
0812 00:00:15.450049 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":96,"threads_started":1}
I20260812 00:00:15.456447 29728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:15.453484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:40121 (local address 127.25.103.67:35953)
0812 00:00:15.453545 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:15.453547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:15.453590 (+ 43us) server_negotiation.cc:407] Connection header received
0812 00:00:15.453616 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:15.453617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:15.453626 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:15.453666 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:15.453945 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.454484 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.455354 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.455575 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.455638 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:15.455947 (+ 309us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:15.455981 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:15.456133 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:15.456317 (+ 184us) server_negotiation.cc:299] Negotiation successful
0812 00:00:15.456359 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:00:15.456459 29741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:15.453268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:35953 (local address 127.25.103.65:40121)
0812 00:00:15.453473 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:15.453485 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:15.453542 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:15.453736 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:15.453737 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:15.453740 (+ 3us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:00:15.453850 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:15.453852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.454603 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.454604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:15.455257 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:15.455259 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.455683 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.455685 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:15.455783 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:15.455809 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:00:15.456142 (+ 333us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:00:15.456145 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:00:15.456284 (+ 139us) client_negotiation.cc:240] Negotiation successful
0812 00:00:15.456344 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":87,"threads_started":1}
I20260812 00:00:15.459705 29258 raft_consensus.cc:1261] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 FOLLOWER]: Refusing update from remote peer 3fc817616be34ae59d8c2d8546c5537d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:15.459744 29472 raft_consensus.cc:1261] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e [term 1 FOLLOWER]: Refusing update from remote peer 3fc817616be34ae59d8c2d8546c5537d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:15.459995 29723 consensus_queue.cc:1035] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:15.460286 29723 consensus_queue.cc:1035] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:15.468809 29748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:15.466010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:40057 (local address 127.25.103.67:59059)
0812 00:00:15.466159 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:15.466171 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:15.466230 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:15.466390 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:15.466391 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:15.466393 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:00:15.466452 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:15.466454 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.467179 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.467180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:15.467935 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:15.467938 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.468374 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.468375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:15.468420 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:15.468425 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:00:15.468660 (+ 235us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:00:15.468662 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:00:15.468693 (+ 31us) client_negotiation.cc:240] Negotiation successful
0812 00:00:15.468739 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":92,"threads_started":1}
I20260812 00:00:15.468818 29738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:15.466051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:59059 (local address 127.25.103.65:40057)
0812 00:00:15.466105 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:15.466107 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:15.466228 (+ 121us) server_negotiation.cc:407] Connection header received
0812 00:00:15.466297 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:15.466298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:15.466308 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:15.466368 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:15.466581 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.467097 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.468005 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:15.468279 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:15.468338 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:15.468561 (+ 223us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:15.468606 (+ 45us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:15.468653 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:15.468696 (+ 43us) server_negotiation.cc:299] Negotiation successful
0812 00:00:15.468725 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:00:15.476809 28807 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34132:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:15.477020 28807 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34132:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:15.478137 28807 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32: Sending DeleteTablet for 3 replicas of tablet f0d4f36962184edabc3346e942e08ac3
I20260812 00:00:15.478538 29226 tablet_service.cc:1514] Processing DeleteTablet for tablet f0d4f36962184edabc3346e942e08ac3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:15 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:34316
I20260812 00:00:15.478664 29702 tablet_replica.cc:330] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936: stopping tablet replica
I20260812 00:00:15.478641 29007 tablet_service.cc:1514] Processing DeleteTablet for tablet f0d4f36962184edabc3346e942e08ac3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:15 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:57306
I20260812 00:00:15.478730 29702 raft_consensus.cc:2229] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:15.478740 29701 tablet_replica.cc:330] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d: stopping tablet replica
I20260812 00:00:15.478780 29702 raft_consensus.cc:2258] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:15.478785 29701 raft_consensus.cc:2229] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:00:15.478906 29701 raft_consensus.cc:2258] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:15.479189 29702 ts_tablet_manager.cc:1905] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:15.479256 29701 ts_tablet_manager.cc:1905] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:15.480517 29442 tablet_service.cc:1514] Processing DeleteTablet for tablet f0d4f36962184edabc3346e942e08ac3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:15 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:36858
I20260812 00:00:15.480679 29700 tablet_replica.cc:330] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e: stopping tablet replica
I20260812 00:00:15.480695 29702 ts_tablet_manager.cc:1918] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:00:15.480731 29700 raft_consensus.cc:2229] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:15.480743 29702 log.cc:1196] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/f0d4f36962184edabc3346e942e08ac3
I20260812 00:00:15.480774 29700 raft_consensus.cc:2258] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:15.480983 29702 ts_tablet_manager.cc:1939] T f0d4f36962184edabc3346e942e08ac3 P d7c95b21c2b24c55be9a1f3e55c72936: Deleting consensus metadata
I20260812 00:00:15.481172 29700 ts_tablet_manager.cc:1905] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:15.481429 29701 ts_tablet_manager.cc:1918] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:00:15.481506 29701 log.cc:1196] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-0/wal/wals/f0d4f36962184edabc3346e942e08ac3
I20260812 00:00:15.481467 28789 catalog_manager.cc:4841] TS d7c95b21c2b24c55be9a1f3e55c72936 (127.25.103.66:46489): tablet f0d4f36962184edabc3346e942e08ac3 (table test-table [id=4e65b51a957a47639ab0b36001409074]) successfully deleted
I20260812 00:00:15.481741 29701 ts_tablet_manager.cc:1939] T f0d4f36962184edabc3346e942e08ac3 P 3fc817616be34ae59d8c2d8546c5537d: Deleting consensus metadata
I20260812 00:00:15.482182 28783 catalog_manager.cc:4841] TS 3fc817616be34ae59d8c2d8546c5537d (127.25.103.65:40057): tablet f0d4f36962184edabc3346e942e08ac3 (table test-table [id=4e65b51a957a47639ab0b36001409074]) successfully deleted
I20260812 00:00:15.482849 29700 ts_tablet_manager.cc:1918] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:00:15.482909 29700 log.cc:1196] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/f0d4f36962184edabc3346e942e08ac3
I20260812 00:00:15.483099 29700 ts_tablet_manager.cc:1939] T f0d4f36962184edabc3346e942e08ac3 P ccd5032985984df4af23751368a42d4e: Deleting consensus metadata
I20260812 00:00:15.483611 28784 catalog_manager.cc:4841] TS ccd5032985984df4af23751368a42d4e (127.25.103.67:35953): tablet f0d4f36962184edabc3346e942e08ac3 (table test-table [id=4e65b51a957a47639ab0b36001409074]) successfully deleted
I20260812 00:00:15.484158 28807 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34132:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:00:15.484349 28807 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:00:15.485942 29007 tablet_service.cc:1467] Processing CreateTablet for tablet 173f961b476b46b9a9705dd99b4e34fd (DEFAULT_TABLE table=test-table [id=f515205ef942446d96fc911bebdeae96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:15.486106 29226 tablet_service.cc:1467] Processing CreateTablet for tablet 173f961b476b46b9a9705dd99b4e34fd (DEFAULT_TABLE table=test-table [id=f515205ef942446d96fc911bebdeae96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:15.486157 29007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 173f961b476b46b9a9705dd99b4e34fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:15.486392 29226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 173f961b476b46b9a9705dd99b4e34fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:15.487713 29718 tablet_bootstrap.cc:492] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936: Bootstrap starting.
I20260812 00:00:15.487775 29442 tablet_service.cc:1467] Processing CreateTablet for tablet 173f961b476b46b9a9705dd99b4e34fd (DEFAULT_TABLE table=test-table [id=f515205ef942446d96fc911bebdeae96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:15.487859 29716 tablet_bootstrap.cc:492] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d: Bootstrap starting.
I20260812 00:00:15.487897 29442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 173f961b476b46b9a9705dd99b4e34fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:15.488139 29718 tablet_bootstrap.cc:654] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:15.488299 29716 tablet_bootstrap.cc:654] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:15.489169 29716 tablet_bootstrap.cc:492] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d: No bootstrap required, opened a new log
I20260812 00:00:15.489235 29716 ts_tablet_manager.cc:1397] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:15.489420 29716 raft_consensus.cc:348] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:15.489507 29716 raft_consensus.cc:374] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:15.489529 29716 raft_consensus.cc:729] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fc817616be34ae59d8c2d8546c5537d, State: Initialized, Role: FOLLOWER
I20260812 00:00:15.489573 29716 consensus_queue.cc:260] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:15.489710 29716 ts_tablet_manager.cc:1428] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:00:15.489724 29717 tablet_bootstrap.cc:492] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e: Bootstrap starting.
I20260812 00:00:15.490167 29717 tablet_bootstrap.cc:654] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:15.490931 29717 tablet_bootstrap.cc:492] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e: No bootstrap required, opened a new log
I20260812 00:00:15.491019 29717 ts_tablet_manager.cc:1397] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:15.491189 29717 raft_consensus.cc:348] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:15.491261 29717 raft_consensus.cc:374] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:15.491279 29717 raft_consensus.cc:729] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd5032985984df4af23751368a42d4e, State: Initialized, Role: FOLLOWER
I20260812 00:00:15.491329 29717 consensus_queue.cc:260] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:15.491456 29717 ts_tablet_manager.cc:1428] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:15.492205 29718 tablet_bootstrap.cc:492] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936: No bootstrap required, opened a new log
I20260812 00:00:15.492275 29718 ts_tablet_manager.cc:1397] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260812 00:00:15.492405 29718 raft_consensus.cc:348] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:15.492476 29718 raft_consensus.cc:374] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:15.492489 29718 raft_consensus.cc:729] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7c95b21c2b24c55be9a1f3e55c72936, State: Initialized, Role: FOLLOWER
I20260812 00:00:15.492528 29718 consensus_queue.cc:260] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:15.492619 29718 ts_tablet_manager.cc:1428] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:15.574575 29744 raft_consensus.cc:482] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:00:15.574729 29744 raft_consensus.cc:504] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:15.574928 29744 leader_election.cc:288] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7c95b21c2b24c55be9a1f3e55c72936 (127.25.103.66:46489), ccd5032985984df4af23751368a42d4e (127.25.103.67:35953)
I20260812 00:00:15.575212 29258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173f961b476b46b9a9705dd99b4e34fd" candidate_uuid: "3fc817616be34ae59d8c2d8546c5537d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" is_pre_election: true
I20260812 00:00:15.575210 29472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173f961b476b46b9a9705dd99b4e34fd" candidate_uuid: "3fc817616be34ae59d8c2d8546c5537d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd5032985984df4af23751368a42d4e" is_pre_election: true
I20260812 00:00:15.575330 29258 raft_consensus.cc:2454] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fc817616be34ae59d8c2d8546c5537d in term 0.
I20260812 00:00:15.575330 29472 raft_consensus.cc:2454] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fc817616be34ae59d8c2d8546c5537d in term 0.
I20260812 00:00:15.575513 28942 leader_election.cc:302] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3fc817616be34ae59d8c2d8546c5537d, ccd5032985984df4af23751368a42d4e, d7c95b21c2b24c55be9a1f3e55c72936; no voters:
I20260812 00:00:15.575654 29744 raft_consensus.cc:2781] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:00:15.575693 29744 raft_consensus.cc:482] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:00:15.575708 29744 raft_consensus.cc:3037] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:15.576618 29744 raft_consensus.cc:504] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:15.576781 29744 leader_election.cc:288] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [CANDIDATE]: Term 1 election: Requested vote from peers d7c95b21c2b24c55be9a1f3e55c72936 (127.25.103.66:46489), ccd5032985984df4af23751368a42d4e (127.25.103.67:35953)
I20260812 00:00:15.577008 29472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173f961b476b46b9a9705dd99b4e34fd" candidate_uuid: "3fc817616be34ae59d8c2d8546c5537d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd5032985984df4af23751368a42d4e"
I20260812 00:00:15.576996 29258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173f961b476b46b9a9705dd99b4e34fd" candidate_uuid: "3fc817616be34ae59d8c2d8546c5537d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7c95b21c2b24c55be9a1f3e55c72936"
I20260812 00:00:15.577090 29472 raft_consensus.cc:3037] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:15.577098 29258 raft_consensus.cc:3037] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:15.577805 29472 raft_consensus.cc:2454] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fc817616be34ae59d8c2d8546c5537d in term 1.
I20260812 00:00:15.578015 28942 leader_election.cc:302] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fc817616be34ae59d8c2d8546c5537d, ccd5032985984df4af23751368a42d4e; no voters:
I20260812 00:00:15.578029 29258 raft_consensus.cc:2454] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fc817616be34ae59d8c2d8546c5537d in term 1.
I20260812 00:00:15.578109 29744 raft_consensus.cc:2781] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:15.578150 29744 raft_consensus.cc:686] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [term 1 LEADER]: Becoming Leader. State: Replica: 3fc817616be34ae59d8c2d8546c5537d, State: Running, Role: LEADER
I20260812 00:00:15.578209 29744 consensus_queue.cc:237] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } }
I20260812 00:00:15.579008 28807 catalog_manager.cc:5495] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fc817616be34ae59d8c2d8546c5537d (127.25.103.65). New cstate: current_term: 1 leader_uuid: "3fc817616be34ae59d8c2d8546c5537d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc817616be34ae59d8c2d8546c5537d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 } health_report { overall_health: UNKNOWN } } }
I20260812 00:00:15.594054 29472 raft_consensus.cc:1261] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e [term 1 FOLLOWER]: Refusing update from remote peer 3fc817616be34ae59d8c2d8546c5537d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:15.594485 29744 consensus_queue.cc:1035] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd5032985984df4af23751368a42d4e" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 35953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:15.594693 29258 raft_consensus.cc:1261] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 FOLLOWER]: Refusing update from remote peer 3fc817616be34ae59d8c2d8546c5537d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:15.594923 29744 consensus_queue.cc:1035] T 173f961b476b46b9a9705dd99b4e34fd P 3fc817616be34ae59d8c2d8546c5537d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7c95b21c2b24c55be9a1f3e55c72936" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 00:00:15.601990 29676 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 00:00:17.125177 28807 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34132:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:17.125305 28807 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34132:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:17.126506 28807 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b08561f132e14f6dbf0b04e88df79b32: Sending DeleteTablet for 3 replicas of tablet 173f961b476b46b9a9705dd99b4e34fd
I20260812 00:00:17.126827 29442 tablet_service.cc:1514] Processing DeleteTablet for tablet 173f961b476b46b9a9705dd99b4e34fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:17 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:36858
I20260812 00:00:17.126847 29226 tablet_service.cc:1514] Processing DeleteTablet for tablet 173f961b476b46b9a9705dd99b4e34fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:17 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:34316
I20260812 00:00:17.127002 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 28908
I20260812 00:00:17.127058 29007 tablet_service.cc:1514] Processing DeleteTablet for tablet 173f961b476b46b9a9705dd99b4e34fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:17 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:57306
I20260812 00:00:17.140626 29801 tablet_replica.cc:330] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e: stopping tablet replica
I20260812 00:00:17.140836 29801 raft_consensus.cc:2229] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:17.140910 29802 tablet_replica.cc:330] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936: stopping tablet replica
I20260812 00:00:17.140969 29801 raft_consensus.cc:2258] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:17.141012 29802 raft_consensus.cc:2229] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:17.141065 29802 raft_consensus.cc:2258] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:17.141398 29801 ts_tablet_manager.cc:1905] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:17.143543 29802 ts_tablet_manager.cc:1905] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:17.143826 29801 ts_tablet_manager.cc:1918] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:00:17.143908 29801 log.cc:1196] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/173f961b476b46b9a9705dd99b4e34fd
I20260812 00:00:17.144146 29801 ts_tablet_manager.cc:1939] T 173f961b476b46b9a9705dd99b4e34fd P ccd5032985984df4af23751368a42d4e: Deleting consensus metadata
I20260812 00:00:17.144694 28784 catalog_manager.cc:4841] TS ccd5032985984df4af23751368a42d4e (127.25.103.67:35953): tablet 173f961b476b46b9a9705dd99b4e34fd (table test-table [id=f515205ef942446d96fc911bebdeae96]) successfully deleted
I20260812 00:00:17.145331 29802 ts_tablet_manager.cc:1918] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:00:17.145391 29802 log.cc:1196] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/173f961b476b46b9a9705dd99b4e34fd
I20260812 00:00:17.145551 29802 ts_tablet_manager.cc:1939] T 173f961b476b46b9a9705dd99b4e34fd P d7c95b21c2b24c55be9a1f3e55c72936: Deleting consensus metadata
I20260812 00:00:17.146186 28789 catalog_manager.cc:4841] TS d7c95b21c2b24c55be9a1f3e55c72936 (127.25.103.66:46489): tablet 173f961b476b46b9a9705dd99b4e34fd (table test-table [id=f515205ef942446d96fc911bebdeae96]) successfully deleted
W20260812 00:00:17.150004 28783 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.103.65:40057 (error 108)
I20260812 00:00:17.150411 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 29115
I20260812 00:00:17.161087 29805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:17.150542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:40057 (local address 127.0.0.1:57318)
0812 00:00:17.160864 (+ 10322us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:17.160998 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:40057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":10259,"thread_start_us":109,"threads_started":1}
W20260812 00:00:17.161343 28783 catalog_manager.cc:4584] TS 3fc817616be34ae59d8c2d8546c5537d (127.25.103.65:40057): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 173f961b476b46b9a9705dd99b4e34fd: Network error: Client connection negotiation failed: client connection to 127.25.103.65:40057: connect: Connection refused (error 111)
I20260812 00:00:17.171505 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 29343
I20260812 00:00:17.206050 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 28759
2026-08-12T00:00:17Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6323 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:00:17 dist-test-slave-vpvm krb5kdc[29814](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:00:17 dist-test-slave-vpvm krb5kdc[29814](info): set up 2 sockets
Aug 12 00:00:17 dist-test-slave-vpvm krb5kdc[29814](info): commencing operation
krb5kdc: starting...
W20260812 00:00:18.485100 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.248s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260812 00:00:18.649048 26013 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.164s user 0.000s sys 0.003s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260812 00:00:18.864992 26013 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.216s user 0.000s sys 0.003s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260812 00:00:19.130849 26013 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.266s user 0.000s sys 0.003s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/test-user.keytab.
W20260812 00:00:19.515236 26013 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.384s user 0.000s sys 0.003s
Aug 12 00:00:19 dist-test-slave-vpvm krb5kdc[29814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:00:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:00:19.574766 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:39405
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:39405
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:19.671093 29835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:19.671482 29835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:19.671523 29835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:19.672927 29835 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:19.672989 29835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:19.673012 29835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:19.673028 29835 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:19.673043 29835 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:00:19.674826 29835 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:39405
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:39405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:19.675138 29835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:19.675405 29835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:19.682065 29847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:19.682101 29835 server_base.cc:1034] running on GCE node
W20260812 00:00:19.682108 29850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:19.682061 29848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:19.682703 29835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:19.683061 29835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:19.684248 29835 hybrid_clock.cc:648] HybridClock initialized: now 1786492819684196 us; error 72 us; skew 500 ppm
Aug 12 00:00:19 dist-test-slave-vpvm krb5kdc[29814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492819, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:19.691666 29835 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:00:19.692241 29835 webserver.cc:460] Webserver started at http://127.25.103.126:45677/ using document root <none> and password file <none>
I20260812 00:00:19.692446 29835 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:19.692487 29835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:19.692596 29835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:19.693734 29835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "f34eb8adea96408593d8757a799952fb"
format_stamp: "Formatted at 2026-08-12 00:00:19 on dist-test-slave-vpvm"
server_key: "804f5211ee7143e79c39dd96d91157a8"
server_key_iv: "ceec6425ca270cd8cb7e734793b01dd5"
server_key_version: "encryptionkey@0"
I20260812 00:00:19.694142 29835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "f34eb8adea96408593d8757a799952fb"
format_stamp: "Formatted at 2026-08-12 00:00:19 on dist-test-slave-vpvm"
server_key: "804f5211ee7143e79c39dd96d91157a8"
server_key_iv: "ceec6425ca270cd8cb7e734793b01dd5"
server_key_version: "encryptionkey@0"
I20260812 00:00:19.695749 29835 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:00:19.697013 29859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:19.697300 29835 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260812 00:00:19.697438 29835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "f34eb8adea96408593d8757a799952fb"
format_stamp: "Formatted at 2026-08-12 00:00:19 on dist-test-slave-vpvm"
server_key: "804f5211ee7143e79c39dd96d91157a8"
server_key_iv: "ceec6425ca270cd8cb7e734793b01dd5"
server_key_version: "encryptionkey@0"
I20260812 00:00:19.697538 29835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:19.707213 29835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:19.709657 29835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:19.709797 29835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:19.713974 29835 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:39405
I20260812 00:00:19.714429 29835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:19.714540 29942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:39405 every 8 connection(s)
I20260812 00:00:19.715158 29943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:19.717676 29943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb: Bootstrap starting.
I20260812 00:00:19.718410 29943 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:19.718711 29943 log.cc:824] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:19.719532 29943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb: No bootstrap required, opened a new log
I20260812 00:00:19.721230 29943 raft_consensus.cc:348] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f34eb8adea96408593d8757a799952fb" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39405 } }
I20260812 00:00:19.721552 29943 raft_consensus.cc:374] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:19.721736 29943 raft_consensus.cc:729] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f34eb8adea96408593d8757a799952fb, State: Initialized, Role: FOLLOWER
I20260812 00:00:19.722087 29943 consensus_queue.cc:260] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f34eb8adea96408593d8757a799952fb" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39405 } }
I20260812 00:00:19.722210 29943 raft_consensus.cc:388] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:19.722239 29943 raft_consensus.cc:482] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:19.722276 29943 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:19.722592 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 29835
I20260812 00:00:19.722713 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:00:19.722918 26013 external_mini_cluster.cc:1428] Setting key aa65783bc45b69cdb613f7bcf33b7d82
I20260812 00:00:19.723516 29943 raft_consensus.cc:504] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f34eb8adea96408593d8757a799952fb" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39405 } }
I20260812 00:00:19.723695 29943 leader_election.cc:302] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f34eb8adea96408593d8757a799952fb; no voters:
I20260812 00:00:19.723927 29943 leader_election.cc:288] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:00:19.723953 29950 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:19.724274 29950 raft_consensus.cc:686] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb [term 1 LEADER]: Becoming Leader. State: Replica: f34eb8adea96408593d8757a799952fb, State: Running, Role: LEADER
I20260812 00:00:19.724421 29943 sys_catalog.cc:564] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:19.724471 29950 consensus_queue.cc:237] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f34eb8adea96408593d8757a799952fb" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39405 } }
I20260812 00:00:19.725265 29951 sys_catalog.cc:455] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f34eb8adea96408593d8757a799952fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f34eb8adea96408593d8757a799952fb" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39405 } } }
I20260812 00:00:19.725404 29951 sys_catalog.cc:458] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:19.725627 29952 sys_catalog.cc:455] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader f34eb8adea96408593d8757a799952fb. Latest consensus state: current_term: 1 leader_uuid: "f34eb8adea96408593d8757a799952fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f34eb8adea96408593d8757a799952fb" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39405 } } }
I20260812 00:00:19.725706 29952 sys_catalog.cc:458] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:19.726146 29959 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:19.726894 29959 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:00:19.729060 29959 catalog_manager.cc:1347] Generated new cluster ID: b50980a26fa244b3980d58993abef0d2
I20260812 00:00:19.729132 29959 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:00:19 dist-test-slave-vpvm krb5kdc[29814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:19.736994 29949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:19.723630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53078 (local address 127.25.103.126:39405)
0812 00:00:19.723905 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:19.723921 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:19.723978 (+ 57us) server_negotiation.cc:407] Connection header received
0812 00:00:19.724268 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:19.724279 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:19.724423 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:19.725479 (+ 1056us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:19.725628 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:19.727276 (+ 1648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:19.728550 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:19.729222 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:19.729383 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:19.732626 (+ 3243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:19.732633 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:19.732633 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:19.732650 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:19.734758 (+ 2108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:19.735258 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:19.735261 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:19.735261 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:19.735401 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:19.735671 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:19.735672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:19.735672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:19.736018 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:19.736173 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:19.736551 (+ 378us) server_negotiation.cc:299] Negotiation successful
0812 00:00:19.736736 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":152,"threads_started":1}
I20260812 00:00:19.780998 29959 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:00:19.781821 29959 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:19.796595 29959 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f34eb8adea96408593d8757a799952fb: Generated new TSK 0
I20260812 00:00:19.796821 29959 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
I20260812 00:00:19.839526 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:39405
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:19.940132 29984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:19.940411 29984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:19.940443 29984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:19.942075 29984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:19.942147 29984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:19.942181 29984 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:00:19.943985 29984 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:39405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:19.944274 29984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:19.944545 29984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:19.950618 29991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:19.950665 29984 server_base.cc:1034] running on GCE node
W20260812 00:00:19.950639 29992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:19.950631 29995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:19.951035 29984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:19.951356 29984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:19.952574 29984 hybrid_clock.cc:648] HybridClock initialized: now 1786492819952554 us; error 31 us; skew 500 ppm
Aug 12 00:00:19 dist-test-slave-vpvm krb5kdc[29814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492819, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:19.956032 29984 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:00:19.956629 29984 webserver.cc:460] Webserver started at http://127.25.103.65:33619/ using document root <none> and password file <none>
I20260812 00:00:19.957008 29984 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:19.957123 29984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:19.957322 29984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:19.958808 29984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "e911e4c776974871ba8360b8702ecdb9"
format_stamp: "Formatted at 2026-08-12 00:00:19 on dist-test-slave-vpvm"
server_key: "66f5c7b1bb37ac7ca63cc737c3cf1670"
server_key_iv: "298072ca2752026f08589d767b217233"
server_key_version: "encryptionkey@0"
I20260812 00:00:19.959223 29984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "e911e4c776974871ba8360b8702ecdb9"
format_stamp: "Formatted at 2026-08-12 00:00:19 on dist-test-slave-vpvm"
server_key: "66f5c7b1bb37ac7ca63cc737c3cf1670"
server_key_iv: "298072ca2752026f08589d767b217233"
server_key_version: "encryptionkey@0"
I20260812 00:00:19.960927 29984 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:00:19.961889 30004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:19.962114 29984 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:19.962227 29984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "e911e4c776974871ba8360b8702ecdb9"
format_stamp: "Formatted at 2026-08-12 00:00:19 on dist-test-slave-vpvm"
server_key: "66f5c7b1bb37ac7ca63cc737c3cf1670"
server_key_iv: "298072ca2752026f08589d767b217233"
server_key_version: "encryptionkey@0"
I20260812 00:00:19.962307 29984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:19.973999 29984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:19.976982 29984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:19.977187 29984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:19.977509 29984 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:19.977912 29984 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:19.977984 29984 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:19.978032 29984 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:19.978058 29984 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:19.985853 29984 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:40431
I20260812 00:00:19.985909 30193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:40431 every 8 connection(s)
I20260812 00:00:19.986348 29984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:00:19.986614 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 29984
I20260812 00:00:19.986704 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:00:19.986924 26013 external_mini_cluster.cc:1428] Setting key 4cdfed9b911d86568c16ed1de9e53c5a
Aug 12 00:00:19 dist-test-slave-vpvm krb5kdc[29814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492819, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.103.66@KRBTEST.COM; defaulting to no policy
I20260812 00:00:19.999495 29949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:19.987268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:58613 (local address 127.25.103.126:39405)
0812 00:00:19.987336 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:19.987338 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:19.987603 (+ 265us) server_negotiation.cc:407] Connection header received
0812 00:00:19.988195 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:19.988197 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:19.988209 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:19.988261 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:19.989360 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:19.989919 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:19.991484 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:19.991698 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:19.991765 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:19.994968 (+ 3203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:19.994970 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:19.994971 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:19.994983 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:19.997223 (+ 2240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:19.997909 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:19.997911 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:19.997911 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:19.998030 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:19.998433 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:19.998435 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:19.998435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:19.998654 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:19.998755 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:19.999290 (+ 535us) server_negotiation.cc:299] Negotiation successful
0812 00:00:19.999415 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:00:19.999948 30197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:19.987241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:39405 (local address 127.25.103.65:58613)
0812 00:00:19.987437 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:19.987492 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:19.988093 (+ 601us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:19.988349 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:19.988355 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:19.989005 (+ 650us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:19.989227 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:19.989234 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:19.990049 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:19.990051 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:19.991314 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:19.991319 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:19.991798 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:19.991799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:19.991989 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:19.992613 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:19.992625 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:19.994797 (+ 2172us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:19.997411 (+ 2614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:19.997436 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:19.997439 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:19.997779 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:19.998117 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:19.998119 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:19.998119 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:19.998286 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:19.998795 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:19.998803 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:19.999000 (+ 197us) client_negotiation.cc:769] Sending connection context
0812 00:00:19.999253 (+ 253us) client_negotiation.cc:240] Negotiation successful
0812 00:00:19.999564 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":101,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.66@KRBTEST.COM" created.
I20260812 00:00:20.001031 30194 heartbeater.cc:347] Connected to a master server at 127.25.103.126:39405
I20260812 00:00:20.001181 30194 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:20.001413 30194 heartbeater.cc:511] Master 127.25.103.126:39405 requested a full tablet report, sending...
I20260812 00:00:20.002283 29886 ts_manager.cc:194] Registered new tserver with Master: e911e4c776974871ba8360b8702ecdb9 (127.25.103.65:40431)
I20260812 00:00:20.003314 29886 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:58613
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
I20260812 00:00:20.021041 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:39405
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:20.119259 30200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:20.119506 30200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:20.119541 30200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:20.120847 30200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:20.120900 30200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:20.120941 30200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:00:20.122614 30200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:39405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:20.122895 30200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:20.123149 30200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:20.129128 30212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:20.129092 30216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:20.129112 30213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:20.129354 30200 server_base.cc:1034] running on GCE node
I20260812 00:00:20.129622 30200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:20.129902 30200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:20.131165 30200 hybrid_clock.cc:648] HybridClock initialized: now 1786492820131127 us; error 37 us; skew 500 ppm
Aug 12 00:00:20 dist-test-slave-vpvm krb5kdc[29814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492820, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:20.134722 30200 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:00:20.135241 30200 webserver.cc:460] Webserver started at http://127.25.103.66:46301/ using document root <none> and password file <none>
I20260812 00:00:20.135500 30200 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:20.135586 30200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:20.135826 30200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:20.137324 30200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "afda3b67eef3411198ca3681ceb72303"
format_stamp: "Formatted at 2026-08-12 00:00:20 on dist-test-slave-vpvm"
server_key: "3bfe1bb4ea2def6a86af4bc033387487"
server_key_iv: "ced170b94b08bb3ac9d75ce32b5b8383"
server_key_version: "encryptionkey@0"
I20260812 00:00:20.137805 30200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "afda3b67eef3411198ca3681ceb72303"
format_stamp: "Formatted at 2026-08-12 00:00:20 on dist-test-slave-vpvm"
server_key: "3bfe1bb4ea2def6a86af4bc033387487"
server_key_iv: "ced170b94b08bb3ac9d75ce32b5b8383"
server_key_version: "encryptionkey@0"
I20260812 00:00:20.139680 30200 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:20.140761 30225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:20.141111 30200 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:20.141245 30200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "afda3b67eef3411198ca3681ceb72303"
format_stamp: "Formatted at 2026-08-12 00:00:20 on dist-test-slave-vpvm"
server_key: "3bfe1bb4ea2def6a86af4bc033387487"
server_key_iv: "ced170b94b08bb3ac9d75ce32b5b8383"
server_key_version: "encryptionkey@0"
I20260812 00:00:20.141405 30200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:20.157697 30200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:20.160837 30200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:20.161026 30200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:20.161295 30200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:20.161664 30200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:20.161703 30200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:20.161736 30200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:20.161753 30200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:20.168587 30200 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:39329
I20260812 00:00:20.168679 30403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:39329 every 8 connection(s)
I20260812 00:00:20.169010 30200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:00:20.169751 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 30200
I20260812 00:00:20.169853 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:00:20.170117 26013 external_mini_cluster.cc:1428] Setting key 11d4319ec007c540ac8561ea19125ead
Aug 12 00:00:20 dist-test-slave-vpvm krb5kdc[29814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492820, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.103.67@KRBTEST.COM; defaulting to no policy
I20260812 00:00:20.179963 29949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:20.169887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:52597 (local address 127.25.103.126:39405)
0812 00:00:20.169979 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:20.169981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:20.170221 (+ 240us) server_negotiation.cc:407] Connection header received
0812 00:00:20.170842 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:20.170842 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:20.170851 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:20.170895 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:20.172208 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:20.172742 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:20.173786 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:20.174022 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:20.174077 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:20.176419 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:20.176421 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:20.176421 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:20.176430 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:20.178239 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:20.178823 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:20.178824 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:20.178825 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:20.178890 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:20.179168 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:20.179169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:20.179169 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:20.179329 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:20.179394 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:20.179727 (+ 333us) server_negotiation.cc:299] Negotiation successful
0812 00:00:20.179848 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:00:20.180187 30409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:20.169845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:39405 (local address 127.25.103.66:52597)
0812 00:00:20.170069 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:20.170121 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:20.170745 (+ 624us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:20.170965 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:20.170970 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:20.171787 (+ 817us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:20.172085 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:20.172092 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:20.172841 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:20.172842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:20.173692 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:20.173694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:20.174107 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:20.174108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:20.174245 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:20.174805 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:20.174814 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:20.176317 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:20.178381 (+ 2064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:20.178397 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:20.178400 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:20.178739 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:20.178957 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:20.178958 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:20.178959 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:20.179101 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:20.179394 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:20.179403 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:20.179588 (+ 185us) client_negotiation.cc:769] Sending connection context
0812 00:00:20.179704 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 00:00:20.179917 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":125,"threads_started":1}
I20260812 00:00:20.181015 30405 heartbeater.cc:347] Connected to a master server at 127.25.103.126:39405
I20260812 00:00:20.181130 30405 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:20.181334 30405 heartbeater.cc:511] Master 127.25.103.126:39405 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.67@KRBTEST.COM" created.
I20260812 00:00:20.181972 29886 ts_manager.cc:194] Registered new tserver with Master: afda3b67eef3411198ca3681ceb72303 (127.25.103.66:39329)
I20260812 00:00:20.182462 29886 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:52597
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
I20260812 00:00:20.201229 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:39405
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:20.299396 30416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:20.299636 30416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:20.299674 30416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:20.301138 30416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:20.301195 30416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:20.301237 30416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:00:20.303197 30416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:39405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:20.303514 30416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:20.303761 30416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:20.309458 30429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:20.309592 30426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:20.309617 30424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:20.310282 30416 server_base.cc:1034] running on GCE node
I20260812 00:00:20.310678 30416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:20.311098 30416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:20.312291 30416 hybrid_clock.cc:648] HybridClock initialized: now 1786492820312228 us; error 82 us; skew 500 ppm
Aug 12 00:00:20 dist-test-slave-vpvm krb5kdc[29814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492820, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:20.315785 30416 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:00:20.316370 30416 webserver.cc:460] Webserver started at http://127.25.103.67:41451/ using document root <none> and password file <none>
I20260812 00:00:20.316629 30416 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:20.316689 30416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:20.316833 30416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:20.318115 30416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "ed43954251a64e59b147df32bf006efa"
format_stamp: "Formatted at 2026-08-12 00:00:20 on dist-test-slave-vpvm"
server_key: "df938a5d4979978af723006634f027e7"
server_key_iv: "4e2ab15226d6b1384903320cdd5b5a09"
server_key_version: "encryptionkey@0"
I20260812 00:00:20.318482 30416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "ed43954251a64e59b147df32bf006efa"
format_stamp: "Formatted at 2026-08-12 00:00:20 on dist-test-slave-vpvm"
server_key: "df938a5d4979978af723006634f027e7"
server_key_iv: "4e2ab15226d6b1384903320cdd5b5a09"
server_key_version: "encryptionkey@0"
I20260812 00:00:20.320283 30416 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 00:00:20.321625 30443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:20.321940 30416 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:20.322129 30416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "ed43954251a64e59b147df32bf006efa"
format_stamp: "Formatted at 2026-08-12 00:00:20 on dist-test-slave-vpvm"
server_key: "df938a5d4979978af723006634f027e7"
server_key_iv: "4e2ab15226d6b1384903320cdd5b5a09"
server_key_version: "encryptionkey@0"
I20260812 00:00:20.322222 30416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:20.344170 30416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:20.346899 30416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:20.347182 30416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:20.347507 30416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:20.347934 30416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:20.347973 30416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:20.348008 30416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:20.348027 30416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:20.355168 30416 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:45349
I20260812 00:00:20.355221 30610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:45349 every 8 connection(s)
I20260812 00:00:20.355561 30416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:00:20.359481 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 30416
I20260812 00:00:20.359572 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:00:20.359741 26013 external_mini_cluster.cc:1428] Setting key f5b9a0776353bda0dd092a4c1eda0dcd
Aug 12 00:00:20 dist-test-slave-vpvm krb5kdc[29814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492820, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:20.366613 29949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:20.356284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:53181 (local address 127.25.103.126:39405)
0812 00:00:20.356354 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:20.356357 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:20.356572 (+ 215us) server_negotiation.cc:407] Connection header received
0812 00:00:20.357083 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:20.357084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:20.357099 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:20.357151 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:20.358195 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:20.358722 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:20.359954 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:20.360233 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:20.360308 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:20.362925 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:20.362927 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:20.362928 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:20.362941 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:20.364766 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:20.365361 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:20.365362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:20.365363 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:20.365444 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:20.365849 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:20.365850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:20.365851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:20.366043 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:20.366115 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:20.366409 (+ 294us) server_negotiation.cc:299] Negotiation successful
0812 00:00:20.366513 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:00:20.366820 30613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:20.356257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:39405 (local address 127.25.103.67:53181)
0812 00:00:20.356418 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:20.356458 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:20.356972 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:20.357233 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:20.357237 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:20.357842 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:20.358091 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:20.358096 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:20.358818 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:20.358819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:20.359859 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:20.359864 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:20.360354 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:20.360355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:20.360612 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:20.361182 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:20.361191 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:20.362748 (+ 1557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:20.364890 (+ 2142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:20.364900 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:20.364903 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:20.365243 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:20.365598 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:20.365600 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:20.365600 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:20.365733 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:20.366110 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:20.366118 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:20.366271 (+ 153us) client_negotiation.cc:769] Sending connection context
0812 00:00:20.366383 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 00:00:20.366581 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":86,"threads_started":1}
I20260812 00:00:20.367429 30611 heartbeater.cc:347] Connected to a master server at 127.25.103.126:39405
I20260812 00:00:20.367548 30611 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:20.367815 30611 heartbeater.cc:511] Master 127.25.103.126:39405 requested a full tablet report, sending...
I20260812 00:00:20.368281 29886 ts_manager.cc:194] Registered new tserver with Master: ed43954251a64e59b147df32bf006efa (127.25.103.67:45349)
I20260812 00:00:20.368798 29886 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:53181
I20260812 00:00:20.372035 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 00:00:20.385360 29949 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:20.384466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53090 (local address 127.25.103.126:39405)
0812 00:00:20.384523 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:20.384524 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:20.384593 (+ 69us) server_negotiation.cc:407] Connection header received
0812 00:00:20.384652 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:20.384653 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:20.384662 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:20.384721 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:20.385295 (+ 574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53090: BlockingRecv error: recv got EOF from 127.0.0.1:53090 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:00:20.386979 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 29984
I20260812 00:00:20.408118 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 30200
I20260812 00:00:20.415515 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 30416
I20260812 00:00:20.452277 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 29835
2026-08-12T00:00:20Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3245 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:00:20 dist-test-slave-vpvm krb5kdc[30632](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:00:20 dist-test-slave-vpvm krb5kdc[30632](info): set up 2 sockets
Aug 12 00:00:20 dist-test-slave-vpvm krb5kdc[30632](info): commencing operation
krb5kdc: starting...
W20260812 00:00:21.693917 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.211s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:00:21 dist-test-slave-vpvm krb5kdc[30632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:00:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:00:21.841939 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:43581
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:39143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:43581
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:21.935374 30660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:21.935635 30660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:21.935659 30660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:21.936985 30660 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:21.937050 30660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:21.937064 30660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:21.937075 30660 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:21.937088 30660 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:00:21.938840 30660 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:39143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:43581
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:43581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:21.939117 30660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:21.939385 30660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:00:21.945611 30660 server_base.cc:1034] running on GCE node
W20260812 00:00:21.945582 30665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:21.945586 30669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:21.945571 30666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:21.946477 30660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:21.946807 30660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:21.947990 30660 hybrid_clock.cc:648] HybridClock initialized: now 1786492821947942 us; error 69 us; skew 500 ppm
Aug 12 00:00:21 dist-test-slave-vpvm krb5kdc[30632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492821, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:21.950969 30660 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:00:21.951457 30660 webserver.cc:460] Webserver started at http://127.25.103.126:45213/ using document root <none> and password file <none>
I20260812 00:00:21.951658 30660 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:21.951704 30660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:21.951802 30660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:21.952937 30660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "38e3eba17be2418cbfa737bcb23d2312"
format_stamp: "Formatted at 2026-08-12 00:00:21 on dist-test-slave-vpvm"
server_key: "acfeceadf94d34b107946205ba697639"
server_key_iv: "23b5ae0cbfcff50a8143c706334c9d0b"
server_key_version: "encryptionkey@0"
I20260812 00:00:21.953285 30660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "38e3eba17be2418cbfa737bcb23d2312"
format_stamp: "Formatted at 2026-08-12 00:00:21 on dist-test-slave-vpvm"
server_key: "acfeceadf94d34b107946205ba697639"
server_key_iv: "23b5ae0cbfcff50a8143c706334c9d0b"
server_key_version: "encryptionkey@0"
I20260812 00:00:21.954854 30660 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:00:21.955921 30681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:21.956244 30660 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:00:21.956358 30660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "38e3eba17be2418cbfa737bcb23d2312"
format_stamp: "Formatted at 2026-08-12 00:00:21 on dist-test-slave-vpvm"
server_key: "acfeceadf94d34b107946205ba697639"
server_key_iv: "23b5ae0cbfcff50a8143c706334c9d0b"
server_key_version: "encryptionkey@0"
I20260812 00:00:21.956446 30660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:21.976732 30660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:21.979640 30660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:21.979846 30660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:21.985551 30660 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:43581
I20260812 00:00:21.985596 30759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:43581 every 8 connection(s)
I20260812 00:00:21.986289 30660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:21.987301 30760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:21.989858 30760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312: Bootstrap starting.
I20260812 00:00:21.990429 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 30660
I20260812 00:00:21.990547 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:00:21.990595 30760 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:21.990769 26013 external_mini_cluster.cc:1428] Setting key 86d4e487d3671e9b2dbe482f90435c13
I20260812 00:00:21.990923 30760 log.cc:824] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:21.992002 30760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312: No bootstrap required, opened a new log
I20260812 00:00:21.995611 30760 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e3eba17be2418cbfa737bcb23d2312" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 43581 } }
I20260812 00:00:21.995807 30760 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:21.995831 30760 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38e3eba17be2418cbfa737bcb23d2312, State: Initialized, Role: FOLLOWER
I20260812 00:00:21.995966 30760 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e3eba17be2418cbfa737bcb23d2312" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 43581 } }
I20260812 00:00:21.996042 30760 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:21.996076 30760 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:21.996121 30760 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:21.997097 30760 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e3eba17be2418cbfa737bcb23d2312" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 43581 } }
I20260812 00:00:21.997253 30760 leader_election.cc:302] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38e3eba17be2418cbfa737bcb23d2312; no voters:
I20260812 00:00:21.997460 30760 leader_election.cc:288] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:00:21.997562 30776 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:21.997915 30776 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312 [term 1 LEADER]: Becoming Leader. State: Replica: 38e3eba17be2418cbfa737bcb23d2312, State: Running, Role: LEADER
I20260812 00:00:21.997993 30760 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:21.998248 30776 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e3eba17be2418cbfa737bcb23d2312" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 43581 } }
I20260812 00:00:21.998896 30778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38e3eba17be2418cbfa737bcb23d2312" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e3eba17be2418cbfa737bcb23d2312" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 43581 } } }
I20260812 00:00:21.999008 30778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:21.999312 30777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38e3eba17be2418cbfa737bcb23d2312. Latest consensus state: current_term: 1 leader_uuid: "38e3eba17be2418cbfa737bcb23d2312" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e3eba17be2418cbfa737bcb23d2312" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 43581 } } }
I20260812 00:00:22.000073 30777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312 [sys.catalog]: This master's current role is: LEADER
W20260812 00:00:22.000475 30797 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:00:22.000535 30797 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:00:22.000620 30790 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 12 00:00:21 dist-test-slave-vpvm krb5kdc[30632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:22.001015 30790 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:00:22.003778 30790 catalog_manager.cc:1347] Generated new cluster ID: c1d569eab3be48669ed8cb4755c0a791
I20260812 00:00:22.003858 30790 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:00:22.007309 30775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:21.991503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44504 (local address 127.25.103.126:43581)
0812 00:00:21.991757 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:21.991771 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:21.991859 (+ 88us) server_negotiation.cc:407] Connection header received
0812 00:00:21.992667 (+ 808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:21.992679 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:21.992773 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:21.992981 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:21.993718 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:21.995377 (+ 1659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:21.996580 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:21.997380 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:21.997525 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:22.001614 (+ 4089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:22.001620 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:22.001620 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:22.001638 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:22.004432 (+ 2794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:22.005033 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:22.005037 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:22.005037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:22.005149 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:22.005317 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:22.005317 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:22.005318 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:22.005627 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:22.005774 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:22.006367 (+ 593us) server_negotiation.cc:299] Negotiation successful
0812 00:00:22.006530 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":116,"threads_started":1}
I20260812 00:00:22.008714 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:00:22.012208 30790 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:00:22.012828 30790 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:22.016980 30790 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38e3eba17be2418cbfa737bcb23d2312: Generated new TSK 0
I20260812 00:00:22.017179 30790 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:00:22.029021 30775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:22.025066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44516 (local address 127.25.103.126:43581)
0812 00:00:22.025129 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:22.025131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:22.025276 (+ 145us) server_negotiation.cc:407] Connection header received
0812 00:00:22.025360 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:22.025361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:22.025372 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:22.025422 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:22.025913 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:22.026605 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:22.027385 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:22.027606 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:22.027665 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:22.028543 (+ 878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:22.028544 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:22.028545 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:00:22.028753 (+ 208us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:22.028770 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:00:22.028778 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:22.028826 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:22.028896 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 00:00:22.028930 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:00:22.031795 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 30660
2026-08-12T00:00:22Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1588 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:00:22 dist-test-slave-vpvm krb5kdc[30814](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:00:22 dist-test-slave-vpvm krb5kdc[30814](info): set up 2 sockets
Aug 12 00:00:22 dist-test-slave-vpvm krb5kdc[30814](info): commencing operation
krb5kdc: starting...
W20260812 00:00:23.278986 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.207s user 0.001s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:00:23 dist-test-slave-vpvm krb5kdc[30814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492823, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:00:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:00:23.423311 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:41445
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:41523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:41445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:23.521093 30834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:23.521349 30834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:23.521412 30834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:23.522845 30834 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:23.522914 30834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:23.522929 30834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:23.522941 30834 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:23.522953 30834 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:00:23.524767 30834 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:41523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:41445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:41445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:23.525072 30834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:23.525349 30834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:23.531937 30839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:23.531948 30840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:23.532033 30834 server_base.cc:1034] running on GCE node
W20260812 00:00:23.531955 30842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:23.532627 30834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:23.533056 30834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:23.534235 30834 hybrid_clock.cc:648] HybridClock initialized: now 1786492823534212 us; error 38 us; skew 500 ppm
Aug 12 00:00:23 dist-test-slave-vpvm krb5kdc[30814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492823, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:23.537554 30834 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:00:23.538129 30834 webserver.cc:460] Webserver started at http://127.25.103.126:43073/ using document root <none> and password file <none>
I20260812 00:00:23.538390 30834 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:23.538443 30834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:23.538560 30834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:23.539858 30834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "cc5bce8bc1b94dffbea306a4df24893f"
format_stamp: "Formatted at 2026-08-12 00:00:23 on dist-test-slave-vpvm"
server_key: "dd188acb8df29493cff5aed569b26f04"
server_key_iv: "6e0e329c8183ae1ed5010cbc910ec44c"
server_key_version: "encryptionkey@0"
I20260812 00:00:23.540246 30834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "cc5bce8bc1b94dffbea306a4df24893f"
format_stamp: "Formatted at 2026-08-12 00:00:23 on dist-test-slave-vpvm"
server_key: "dd188acb8df29493cff5aed569b26f04"
server_key_iv: "6e0e329c8183ae1ed5010cbc910ec44c"
server_key_version: "encryptionkey@0"
I20260812 00:00:23.541774 30834 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:00:23.542922 30853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:23.543303 30834 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:23.543473 30834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "cc5bce8bc1b94dffbea306a4df24893f"
format_stamp: "Formatted at 2026-08-12 00:00:23 on dist-test-slave-vpvm"
server_key: "dd188acb8df29493cff5aed569b26f04"
server_key_iv: "6e0e329c8183ae1ed5010cbc910ec44c"
server_key_version: "encryptionkey@0"
I20260812 00:00:23.543591 30834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:23.560637 30834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:23.563867 30834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:23.564059 30834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:23.569499 30834 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:41445
I20260812 00:00:23.569532 30939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:41445 every 8 connection(s)
I20260812 00:00:23.570006 30834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:23.571448 30940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:23.571911 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 30834
I20260812 00:00:23.572033 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:00:23.572232 26013 external_mini_cluster.cc:1428] Setting key f732a0e1a7d8beb9e5df84ff4398452e
I20260812 00:00:23.574810 30940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f: Bootstrap starting.
I20260812 00:00:23.575583 30940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:23.575928 30940 log.cc:824] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:23.576990 30940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f: No bootstrap required, opened a new log
I20260812 00:00:23.579461 30940 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc5bce8bc1b94dffbea306a4df24893f" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 41445 } }
I20260812 00:00:23.579639 30940 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:23.579663 30940 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5bce8bc1b94dffbea306a4df24893f, State: Initialized, Role: FOLLOWER
I20260812 00:00:23.579818 30940 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc5bce8bc1b94dffbea306a4df24893f" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 41445 } }
I20260812 00:00:23.579910 30940 raft_consensus.cc:388] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:23.579938 30940 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:23.579990 30940 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:23.580652 30940 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc5bce8bc1b94dffbea306a4df24893f" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 41445 } }
I20260812 00:00:23.580753 30940 leader_election.cc:302] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc5bce8bc1b94dffbea306a4df24893f; no voters:
Aug 12 00:00:23 dist-test-slave-vpvm krb5kdc[30814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492823, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:23.580942 30940 leader_election.cc:288] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:00:23.580983 30954 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:23.581173 30954 raft_consensus.cc:686] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f [term 1 LEADER]: Becoming Leader. State: Replica: cc5bce8bc1b94dffbea306a4df24893f, State: Running, Role: LEADER
I20260812 00:00:23.581264 30954 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc5bce8bc1b94dffbea306a4df24893f" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 41445 } }
I20260812 00:00:23.581318 30940 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:23.581679 30954 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc5bce8bc1b94dffbea306a4df24893f. Latest consensus state: current_term: 1 leader_uuid: "cc5bce8bc1b94dffbea306a4df24893f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc5bce8bc1b94dffbea306a4df24893f" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 41445 } } }
I20260812 00:00:23.581700 30958 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc5bce8bc1b94dffbea306a4df24893f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc5bce8bc1b94dffbea306a4df24893f" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 41445 } } }
I20260812 00:00:23.581837 30954 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:23.582248 30958 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:23.582269 30965 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:23.583612 30965 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:00:23.585572 30965 catalog_manager.cc:1347] Generated new cluster ID: b574f10cf8c44d3e810bc16db8476324
I20260812 00:00:23.585628 30965 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:00:23.586690 30951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:23.572990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48814 (local address 127.25.103.126:41445)
0812 00:00:23.573241 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:23.573252 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:23.573290 (+ 38us) server_negotiation.cc:407] Connection header received
0812 00:00:23.573892 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:23.573902 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:23.574004 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:23.574179 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:23.574982 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:23.576437 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:23.577468 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:23.578170 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:23.578309 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:23.582027 (+ 3718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:23.582036 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:23.582037 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:23.582057 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:23.584504 (+ 2447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:23.585112 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:23.585115 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:23.585116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:23.585247 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:23.585499 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:23.585500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:23.585500 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:23.585880 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:23.586065 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:23.586261 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 00:00:23.586454 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":123,"threads_started":1}
I20260812 00:00:23.596908 30965 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:00:23.597472 30965 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:23.604599 30965 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cc5bce8bc1b94dffbea306a4df24893f: Generated new TSK 0
I20260812 00:00:23.604866 30965 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
I20260812 00:00:23.642937 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:41445
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:41523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:23.741637 30989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:23.741901 30989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:23.741931 30989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:23.743335 30989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:23.743404 30989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:23.743434 30989 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:00:23.745065 30989 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:41523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:41445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30989
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:23.745301 30989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:23.745509 30989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:23.751866 30997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:23.752010 30998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:23.751991 31000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:23.752333 30989 server_base.cc:1034] running on GCE node
I20260812 00:00:23.752691 30989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:23.753041 30989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:23.754236 30989 hybrid_clock.cc:648] HybridClock initialized: now 1786492823754212 us; error 52 us; skew 500 ppm
Aug 12 00:00:23 dist-test-slave-vpvm krb5kdc[30814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492823, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:23.757278 30989 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:00:23.758023 30989 webserver.cc:460] Webserver started at http://127.25.103.65:43491/ using document root <none> and password file <none>
I20260812 00:00:23.758262 30989 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:23.758314 30989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:23.758459 30989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:23.759609 30989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "e89f2a65fefe458db74d2c181c1fb1b3"
format_stamp: "Formatted at 2026-08-12 00:00:23 on dist-test-slave-vpvm"
server_key: "3910a1aa757aa4470ffc5f2d5b98d6a7"
server_key_iv: "9ce2bbe0fd9055a3171243a9c2b12cdd"
server_key_version: "encryptionkey@0"
I20260812 00:00:23.759994 30989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "e89f2a65fefe458db74d2c181c1fb1b3"
format_stamp: "Formatted at 2026-08-12 00:00:23 on dist-test-slave-vpvm"
server_key: "3910a1aa757aa4470ffc5f2d5b98d6a7"
server_key_iv: "9ce2bbe0fd9055a3171243a9c2b12cdd"
server_key_version: "encryptionkey@0"
I20260812 00:00:23.761520 30989 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:00:23.762648 31009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:23.762852 30989 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:00:23.762953 30989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "e89f2a65fefe458db74d2c181c1fb1b3"
format_stamp: "Formatted at 2026-08-12 00:00:23 on dist-test-slave-vpvm"
server_key: "3910a1aa757aa4470ffc5f2d5b98d6a7"
server_key_iv: "9ce2bbe0fd9055a3171243a9c2b12cdd"
server_key_version: "encryptionkey@0"
I20260812 00:00:23.763028 30989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:23.772784 30989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:23.775755 30989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:23.775940 30989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:23.776202 30989 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:23.776532 30989 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:23.776571 30989 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:23.776602 30989 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:23.776628 30989 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:23.783048 30989 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:37755
I20260812 00:00:23.783221 31183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:37755 every 8 connection(s)
I20260812 00:00:23.783564 30989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:00:23.790010 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 30989
I20260812 00:00:23.790138 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:00:23.790369 26013 external_mini_cluster.cc:1428] Setting key 133a8b805f508e6d25d6750771b2fc8d
Aug 12 00:00:23 dist-test-slave-vpvm krb5kdc[30814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492823, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:23.795814 30951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:23.784508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:35405 (local address 127.25.103.126:41445)
0812 00:00:23.784671 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:23.784674 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:23.784877 (+ 203us) server_negotiation.cc:407] Connection header received
0812 00:00:23.786466 (+ 1589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:23.786468 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:23.786484 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:23.786544 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:23.787386 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:23.787989 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:23.789092 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:23.789326 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:23.789387 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:23.792374 (+ 2987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:23.792376 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:23.792377 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:23.792445 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:23.794160 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:23.794628 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:23.794630 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:23.794630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:23.794699 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:23.794960 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:23.794961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:23.794961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:23.795096 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:23.795162 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:23.795578 (+ 416us) server_negotiation.cc:299] Negotiation successful
0812 00:00:23.795724 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 00:00:23.795956 31189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:23.784429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:41445 (local address 127.25.103.65:35405)
0812 00:00:23.784693 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:23.784756 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:23.786312 (+ 1556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:23.786644 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:23.786649 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:23.787008 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:23.787280 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:23.787286 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:23.788082 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:23.788083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:23.789004 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:23.789007 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:23.789404 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:23.789406 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:23.789541 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:23.790279 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:23.790292 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:23.792224 (+ 1932us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:23.794259 (+ 2035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:23.794270 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:23.794273 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:23.794546 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:23.794780 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:23.794781 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:23.794781 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:23.794896 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:23.795158 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:23.795165 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:23.795356 (+ 191us) client_negotiation.cc:769] Sending connection context
0812 00:00:23.795479 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 00:00:23.795675 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":91,"threads_started":1}
I20260812 00:00:23.796794 31184 heartbeater.cc:347] Connected to a master server at 127.25.103.126:41445
I20260812 00:00:23.796931 31184 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:23.797170 31184 heartbeater.cc:511] Master 127.25.103.126:41445 requested a full tablet report, sending...
I20260812 00:00:23.797991 30885 ts_manager.cc:194] Registered new tserver with Master: e89f2a65fefe458db74d2c181c1fb1b3 (127.25.103.65:37755)
I20260812 00:00:23.798668 30885 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:35405
WARNING: no policy specified for kudu/127.25.103.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
I20260812 00:00:23.825003 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:41445
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:41523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:23.915938 31192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:23.916211 31192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:23.916249 31192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:23.917860 31192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:23.918026 31192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:23.918084 31192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:00:23.920531 31192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:41523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:41445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:23.920874 31192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:23.921170 31192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:23.927418 31202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:23.927469 31201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:23.927412 31207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:23.927803 31192 server_base.cc:1034] running on GCE node
I20260812 00:00:23.928042 31192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:23.928356 31192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:23.929539 31192 hybrid_clock.cc:648] HybridClock initialized: now 1786492823929502 us; error 49 us; skew 500 ppm
Aug 12 00:00:23 dist-test-slave-vpvm krb5kdc[30814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492823, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:23.932651 31192 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:00:23.933252 31192 webserver.cc:460] Webserver started at http://127.25.103.66:45255/ using document root <none> and password file <none>
I20260812 00:00:23.933534 31192 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:23.933593 31192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:23.933724 31192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:23.935156 31192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "77fa35f1aabb463c9e4677d73885aa5f"
format_stamp: "Formatted at 2026-08-12 00:00:23 on dist-test-slave-vpvm"
server_key: "3a446388e0e0b722ceff9d1d4b5ef406"
server_key_iv: "cb8a2744d34fa119b3b4936f515067e5"
server_key_version: "encryptionkey@0"
I20260812 00:00:23.935570 31192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "77fa35f1aabb463c9e4677d73885aa5f"
format_stamp: "Formatted at 2026-08-12 00:00:23 on dist-test-slave-vpvm"
server_key: "3a446388e0e0b722ceff9d1d4b5ef406"
server_key_iv: "cb8a2744d34fa119b3b4936f515067e5"
server_key_version: "encryptionkey@0"
I20260812 00:00:23.937176 31192 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:00:23.938465 31218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:23.938663 31192 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:00:23.938767 31192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "77fa35f1aabb463c9e4677d73885aa5f"
format_stamp: "Formatted at 2026-08-12 00:00:23 on dist-test-slave-vpvm"
server_key: "3a446388e0e0b722ceff9d1d4b5ef406"
server_key_iv: "cb8a2744d34fa119b3b4936f515067e5"
server_key_version: "encryptionkey@0"
I20260812 00:00:23.938859 31192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:23.960106 31192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:23.963174 31192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:23.963320 31192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:23.963558 31192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:23.963877 31192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:23.963910 31192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:23.963934 31192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:23.963946 31192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:23.971149 31192 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:40263
I20260812 00:00:23.971210 31411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:40263 every 8 connection(s)
I20260812 00:00:23.971583 31192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:00:23.973129 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 31192
I20260812 00:00:23.973219 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:00:23.973395 26013 external_mini_cluster.cc:1428] Setting key 106e49a2caca9d08e4d5b7376174de2c
Aug 12 00:00:23 dist-test-slave-vpvm krb5kdc[30814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492823, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:23.983233 30951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:23.972568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:56701 (local address 127.25.103.126:41445)
0812 00:00:23.972650 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:23.972652 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:23.972876 (+ 224us) server_negotiation.cc:407] Connection header received
0812 00:00:23.973537 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:23.973538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:23.973554 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:23.973612 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:23.974807 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:23.975322 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:23.976704 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:23.976914 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:23.976982 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:23.979363 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:23.979364 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:23.979364 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:23.979373 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:23.980831 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:23.981533 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:23.981536 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:23.981537 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:23.981730 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:23.982207 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:23.982208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:23.982209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:23.982390 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:23.982472 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:23.982987 (+ 515us) server_negotiation.cc:299] Negotiation successful
0812 00:00:23.983114 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
WARNING: no policy specified for kudu/127.25.103.67@KRBTEST.COM; defaulting to no policy
I20260812 00:00:23.983685 31417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:23.972474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:41445 (local address 127.25.103.66:56701)
0812 00:00:23.972732 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:23.972783 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:23.973428 (+ 645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:23.973701 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:23.973705 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:23.974476 (+ 771us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:23.974703 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:23.974709 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:23.975417 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:23.975418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:23.976587 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:23.976591 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:23.977013 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:23.977014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:23.977169 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:23.977718 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:23.977727 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:23.979252 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:23.980965 (+ 1713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:23.980977 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:23.980981 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:23.981349 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:23.981855 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:23.981856 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:23.981857 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:23.982096 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:23.982481 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:23.982488 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:23.982768 (+ 280us) client_negotiation.cc:769] Sending connection context
0812 00:00:23.982934 (+ 166us) client_negotiation.cc:240] Negotiation successful
0812 00:00:23.983176 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":106,"threads_started":1}
I20260812 00:00:23.984524 31412 heartbeater.cc:347] Connected to a master server at 127.25.103.126:41445
I20260812 00:00:23.984661 31412 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:23.984850 31412 heartbeater.cc:511] Master 127.25.103.126:41445 requested a full tablet report, sending...
I20260812 00:00:23.985370 30885 ts_manager.cc:194] Registered new tserver with Master: 77fa35f1aabb463c9e4677d73885aa5f (127.25.103.66:40263)
I20260812 00:00:23.985823 30885 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:56701
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
I20260812 00:00:24.006102 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:41445
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:41523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:24.098968 31423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:24.099211 31423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:24.099241 31423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:24.100538 31423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:24.100589 31423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:24.100618 31423 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:00:24.102288 31423 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:41523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:41445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31423
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:24.102542 31423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:24.102758 31423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:00:24.108620 31423 server_base.cc:1034] running on GCE node
W20260812 00:00:24.108529 31438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:24.108529 31434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:24.108539 31433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:24.109052 31423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:24.109309 31423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:24.110543 31423 hybrid_clock.cc:648] HybridClock initialized: now 1786492824110499 us; error 42 us; skew 500 ppm
Aug 12 00:00:24 dist-test-slave-vpvm krb5kdc[30814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492824, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:24.114460 31423 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:00:24.115384 31423 webserver.cc:460] Webserver started at http://127.25.103.67:42075/ using document root <none> and password file <none>
I20260812 00:00:24.115716 31423 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:24.115778 31423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:24.115916 31423 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:24.117066 31423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "da1ee415e2ea46a49c341985b3c308c3"
format_stamp: "Formatted at 2026-08-12 00:00:24 on dist-test-slave-vpvm"
server_key: "4d4fcb431d4d5826b6d166afc32f6dfe"
server_key_iv: "c921e5b2cef386d703ed7cdb5bbf882e"
server_key_version: "encryptionkey@0"
I20260812 00:00:24.117437 31423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "da1ee415e2ea46a49c341985b3c308c3"
format_stamp: "Formatted at 2026-08-12 00:00:24 on dist-test-slave-vpvm"
server_key: "4d4fcb431d4d5826b6d166afc32f6dfe"
server_key_iv: "c921e5b2cef386d703ed7cdb5bbf882e"
server_key_version: "encryptionkey@0"
I20260812 00:00:24.119082 31423 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:00:24.120087 31451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:24.120289 31423 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:24.120422 31423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "da1ee415e2ea46a49c341985b3c308c3"
format_stamp: "Formatted at 2026-08-12 00:00:24 on dist-test-slave-vpvm"
server_key: "4d4fcb431d4d5826b6d166afc32f6dfe"
server_key_iv: "c921e5b2cef386d703ed7cdb5bbf882e"
server_key_version: "encryptionkey@0"
I20260812 00:00:24.120496 31423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:24.134557 31423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:24.137212 31423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:24.137377 31423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:24.137647 31423 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:24.138005 31423 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:24.138046 31423 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:24.138078 31423 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:24.138103 31423 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:24.144598 31423 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:34731
I20260812 00:00:24.144649 31631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:34731 every 8 connection(s)
I20260812 00:00:24.145002 31423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:00:24 dist-test-slave-vpvm krb5kdc[30814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492824, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:24.154639 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 31423
I20260812 00:00:24.154763 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:00:24.154994 26013 external_mini_cluster.cc:1428] Setting key 6765e1693767720c9cfb4c85e90547d4
I20260812 00:00:24.156805 30951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:24.145864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:43379 (local address 127.25.103.126:41445)
0812 00:00:24.145972 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:24.145975 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:24.146163 (+ 188us) server_negotiation.cc:407] Connection header received
0812 00:00:24.146667 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:24.146669 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:24.146680 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:24.146747 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:24.147953 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:24.148545 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:24.150065 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:24.150297 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:24.150375 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:24.153483 (+ 3108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:24.153486 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:24.153486 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:24.153497 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:24.155221 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:24.155750 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:24.155752 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:24.155752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:24.155813 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:24.156065 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:24.156066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:24.156066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:24.156202 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:24.156265 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:24.156600 (+ 335us) server_negotiation.cc:299] Negotiation successful
0812 00:00:24.156710 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 00:00:24.156982 31635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:24.145805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:41445 (local address 127.25.103.67:43379)
0812 00:00:24.146002 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:24.146047 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:24.146566 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:24.146812 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:24.146816 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:24.147523 (+ 707us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:24.147808 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:24.147816 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:24.148718 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:24.148720 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:24.149853 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:24.149857 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:24.150413 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:24.150414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:24.150560 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:24.151265 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:24.151276 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:24.153240 (+ 1964us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:24.155335 (+ 2095us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:24.155352 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:24.155355 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:24.155661 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:24.155878 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:24.155879 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:24.155879 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:24.156004 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:24.156263 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:24.156270 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:24.156437 (+ 167us) client_negotiation.cc:769] Sending connection context
0812 00:00:24.156535 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 00:00:24.156738 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":84,"threads_started":1}
I20260812 00:00:24.157706 31632 heartbeater.cc:347] Connected to a master server at 127.25.103.126:41445
I20260812 00:00:24.157866 31632 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:24.158159 31632 heartbeater.cc:511] Master 127.25.103.126:41445 requested a full tablet report, sending...
I20260812 00:00:24.158761 30885 ts_manager.cc:194] Registered new tserver with Master: da1ee415e2ea46a49c341985b3c308c3 (127.25.103.67:34731)
I20260812 00:00:24.159166 30885 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:43379
I20260812 00:00:24.167188 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:00:24 dist-test-slave-vpvm krb5kdc[30814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492824, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 00:00:24 dist-test-slave-vpvm krb5kdc[30814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492824, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:24.194237 30951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:24.185896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48824 (local address 127.25.103.126:41445)
0812 00:00:24.186020 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:24.186022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:24.186097 (+ 75us) server_negotiation.cc:407] Connection header received
0812 00:00:24.186173 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:24.186174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:24.186185 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:24.186234 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:24.186877 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:24.187484 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:24.188323 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:24.188524 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:24.188584 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:24.191483 (+ 2899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:24.191486 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:24.191486 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:24.191497 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:24.192908 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:24.193391 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:24.193395 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:24.193395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:24.193459 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:24.193652 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:24.193652 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:24.193653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:24.193829 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:24.193912 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:24.194087 (+ 175us) server_negotiation.cc:299] Negotiation successful
0812 00:00:24.194162 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
W20260812 00:00:24.194520 30885 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:48824
I20260812 00:00:24.195278 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 30989
I20260812 00:00:24.257848 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 31192
I20260812 00:00:24.263656 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 31423
I20260812 00:00:24.273672 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 30834
2026-08-12T00:00:24Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2235 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:00:24 dist-test-slave-vpvm krb5kdc[31652](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:00:24 dist-test-slave-vpvm krb5kdc[31652](info): set up 2 sockets
Aug 12 00:00:24 dist-test-slave-vpvm krb5kdc[31652](info): commencing operation
krb5kdc: starting...
W20260812 00:00:25.509516 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:00:25 dist-test-slave-vpvm krb5kdc[31652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:00:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:00:25.648509 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:36681
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:45833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:36681
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:25.751732 31670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:25.752000 31670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:25.752036 31670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:25.753353 31670 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:25.753404 31670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:25.753424 31670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:25.753443 31670 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:25.753458 31670 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:00:25.755785 31670 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:45833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:36681
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:36681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:25.756219 31670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:25.757416 31670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:25.766288 31678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:25.766288 31676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:25.766324 31675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:25.766757 31670 server_base.cc:1034] running on GCE node
I20260812 00:00:25.767055 31670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:25.767382 31670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:25.768599 31670 hybrid_clock.cc:648] HybridClock initialized: now 1786492825768591 us; error 42 us; skew 500 ppm
Aug 12 00:00:25 dist-test-slave-vpvm krb5kdc[31652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492825, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:25.779286 31670 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:00:25.779995 31670 webserver.cc:460] Webserver started at http://127.25.103.126:45921/ using document root <none> and password file <none>
I20260812 00:00:25.780260 31670 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:25.780314 31670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:25.780638 31670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:25.782569 31670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "96533d8c8754458eb54e2218dab1162a"
format_stamp: "Formatted at 2026-08-12 00:00:25 on dist-test-slave-vpvm"
server_key: "9bf2e03d879007164febd82bbbdaad8c"
server_key_iv: "d82773f50254dd332ee3432e4d0da65e"
server_key_version: "encryptionkey@0"
I20260812 00:00:25.785002 31670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "96533d8c8754458eb54e2218dab1162a"
format_stamp: "Formatted at 2026-08-12 00:00:25 on dist-test-slave-vpvm"
server_key: "9bf2e03d879007164febd82bbbdaad8c"
server_key_iv: "d82773f50254dd332ee3432e4d0da65e"
server_key_version: "encryptionkey@0"
I20260812 00:00:25.786849 31670 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 00:00:25.787873 31689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:25.788082 31670 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:25.788182 31670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "96533d8c8754458eb54e2218dab1162a"
format_stamp: "Formatted at 2026-08-12 00:00:25 on dist-test-slave-vpvm"
server_key: "9bf2e03d879007164febd82bbbdaad8c"
server_key_iv: "d82773f50254dd332ee3432e4d0da65e"
server_key_version: "encryptionkey@0"
I20260812 00:00:25.788256 31670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:25.796759 31670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:25.801009 31670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:25.801172 31670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:25.807386 31670 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:36681
I20260812 00:00:25.807422 31781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:36681 every 8 connection(s)
I20260812 00:00:25.807969 31670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:25.808786 31782 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:25.811127 31782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a: Bootstrap starting.
I20260812 00:00:25.811719 31782 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:25.811964 31782 log.cc:824] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:25.812677 31782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a: No bootstrap required, opened a new log
I20260812 00:00:25.814321 31782 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96533d8c8754458eb54e2218dab1162a" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36681 } }
I20260812 00:00:25.814478 31782 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:25.814502 31782 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96533d8c8754458eb54e2218dab1162a, State: Initialized, Role: FOLLOWER
I20260812 00:00:25.814626 31782 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96533d8c8754458eb54e2218dab1162a" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36681 } }
I20260812 00:00:25.814704 31782 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:25.814728 31782 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:25.814760 31782 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:25.815835 31782 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96533d8c8754458eb54e2218dab1162a" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36681 } }
I20260812 00:00:25.815941 31782 leader_election.cc:302] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96533d8c8754458eb54e2218dab1162a; no voters:
I20260812 00:00:25.816176 31782 leader_election.cc:288] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:00:25.816227 31788 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:25.816478 31782 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:25.816587 31788 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a [term 1 LEADER]: Becoming Leader. State: Replica: 96533d8c8754458eb54e2218dab1162a, State: Running, Role: LEADER
I20260812 00:00:25.816706 31788 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96533d8c8754458eb54e2218dab1162a" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36681 } }
I20260812 00:00:25.816844 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 31670
I20260812 00:00:25.817070 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:00:25.817090 31788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96533d8c8754458eb54e2218dab1162a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96533d8c8754458eb54e2218dab1162a" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36681 } } }
I20260812 00:00:25.817162 31788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:25.817293 26013 external_mini_cluster.cc:1428] Setting key b1d8ca17adba2d3c65c1f20191f087a6
I20260812 00:00:25.817163 31792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96533d8c8754458eb54e2218dab1162a. Latest consensus state: current_term: 1 leader_uuid: "96533d8c8754458eb54e2218dab1162a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96533d8c8754458eb54e2218dab1162a" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36681 } } }
I20260812 00:00:25.817359 31792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:25.817602 31803 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:25.819223 31803 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:00:25.825285 31803 catalog_manager.cc:1347] Generated new cluster ID: 67c6fb9750a8410c8eae0812c8e7cdc7
I20260812 00:00:25.825368 31803 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:00:25 dist-test-slave-vpvm krb5kdc[31652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:25.833386 31812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:25.817977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51976 (local address 127.25.103.126:36681)
0812 00:00:25.818351 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:25.818378 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:25.818678 (+ 300us) server_negotiation.cc:407] Connection header received
0812 00:00:25.819245 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:25.819254 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:25.819322 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:25.819478 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:25.821391 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:25.823999 (+ 2608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:25.825748 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:25.826485 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:25.826616 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:25.829512 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:25.829517 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:25.829518 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:25.829532 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:25.831554 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:25.832055 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:25.832057 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:25.832058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:25.832159 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:25.832350 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:25.832350 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:25.832351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:25.832650 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:25.832782 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:25.832897 (+ 115us) server_negotiation.cc:299] Negotiation successful
0812 00:00:25.833159 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":185,"threads_started":1}
I20260812 00:00:25.842202 31803 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:00:25.843043 31803 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:25.850425 31803 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96533d8c8754458eb54e2218dab1162a: Generated new TSK 0
I20260812 00:00:25.850643 31803 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
I20260812 00:00:25.890113 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:36681
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:45833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:25.994266 31825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:25.994519 31825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:25.994560 31825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:25.996353 31825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:25.996415 31825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:25.996448 31825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:00:25.998831 31825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:45833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:36681
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:25.999257 31825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:25.999527 31825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:26.006290 31832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:26.006280 31835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:26.006290 31833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:26.006718 31825 server_base.cc:1034] running on GCE node
I20260812 00:00:26.006923 31825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:26.007138 31825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:26.008306 31825 hybrid_clock.cc:648] HybridClock initialized: now 1786492826008292 us; error 30 us; skew 500 ppm
Aug 12 00:00:26 dist-test-slave-vpvm krb5kdc[31652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492826, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:26.011003 31825 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:00:26.011428 31825 webserver.cc:460] Webserver started at http://127.25.103.65:33121/ using document root <none> and password file <none>
I20260812 00:00:26.011641 31825 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:26.011691 31825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:26.011823 31825 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:26.012944 31825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "c6d68597dec74497952b4a49815ddcc7"
format_stamp: "Formatted at 2026-08-12 00:00:26 on dist-test-slave-vpvm"
server_key: "e7ab1b949d5bae8318aac1347a9e632f"
server_key_iv: "a2fbe6fba33aeaf2983f19a95901c926"
server_key_version: "encryptionkey@0"
I20260812 00:00:26.013510 31825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "c6d68597dec74497952b4a49815ddcc7"
format_stamp: "Formatted at 2026-08-12 00:00:26 on dist-test-slave-vpvm"
server_key: "e7ab1b949d5bae8318aac1347a9e632f"
server_key_iv: "a2fbe6fba33aeaf2983f19a95901c926"
server_key_version: "encryptionkey@0"
I20260812 00:00:26.015089 31825 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260812 00:00:26.016058 31844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:26.016546 31825 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:26.016656 31825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "c6d68597dec74497952b4a49815ddcc7"
format_stamp: "Formatted at 2026-08-12 00:00:26 on dist-test-slave-vpvm"
server_key: "e7ab1b949d5bae8318aac1347a9e632f"
server_key_iv: "a2fbe6fba33aeaf2983f19a95901c926"
server_key_version: "encryptionkey@0"
I20260812 00:00:26.016790 31825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:26.028406 31825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:26.030635 31825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:26.030786 31825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:26.031028 31825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:26.031343 31825 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:26.031378 31825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:26.031409 31825 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:26.031433 31825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:26.038743 31825 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:33327
I20260812 00:00:26.038789 32040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:33327 every 8 connection(s)
I20260812 00:00:26.039134 31825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:00:26 dist-test-slave-vpvm krb5kdc[31652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492826, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:26.047852 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 31825
I20260812 00:00:26.047981 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:00:26.048169 26013 external_mini_cluster.cc:1428] Setting key cd8131beb77184a93280eb1e50b44905
I20260812 00:00:26.050081 31812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:26.039970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:59917 (local address 127.25.103.126:36681)
0812 00:00:26.040036 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:26.040038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:26.040452 (+ 414us) server_negotiation.cc:407] Connection header received
0812 00:00:26.041309 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:26.041310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:26.041323 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:26.041464 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:26.042238 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:26.043158 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:26.044258 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:26.044477 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:26.044541 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:26.046912 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:26.046914 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:26.046914 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:26.046921 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:26.048406 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:26.048943 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:26.048944 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:26.048944 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:26.049000 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:26.049320 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:26.049321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:26.049322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:26.049449 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:26.049516 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:26.049867 (+ 351us) server_negotiation.cc:299] Negotiation successful
0812 00:00:26.049993 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:00:26.050256 32044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:26.039934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:36681 (local address 127.25.103.65:59917)
0812 00:00:26.040110 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:26.040148 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:26.041071 (+ 923us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:26.041520 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:26.041524 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:26.041785 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:26.042048 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:26.042053 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:26.043324 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:26.043325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:26.044161 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:26.044164 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:26.044587 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:26.044588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:26.044707 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:26.045323 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:26.045332 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:26.046819 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:26.048564 (+ 1745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:26.048572 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:26.048574 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:26.048871 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:26.049060 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:26.049061 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:26.049061 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:26.049208 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:26.049521 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:26.049528 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:26.049706 (+ 178us) client_negotiation.cc:769] Sending connection context
0812 00:00:26.049819 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 00:00:26.050027 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":93,"threads_started":1}
I20260812 00:00:26.051182 32042 heartbeater.cc:347] Connected to a master server at 127.25.103.126:36681
I20260812 00:00:26.051280 32042 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:26.051468 32042 heartbeater.cc:511] Master 127.25.103.126:36681 requested a full tablet report, sending...
I20260812 00:00:26.051986 31714 ts_manager.cc:194] Registered new tserver with Master: c6d68597dec74497952b4a49815ddcc7 (127.25.103.65:33327)
I20260812 00:00:26.052600 31714 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:59917
WARNING: no policy specified for kudu/127.25.103.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
I20260812 00:00:26.077303 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:36681
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:45833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:26.177675 32050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:26.177925 32050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:26.177994 32050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:26.180439 32050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:26.180521 32050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:26.180572 32050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:00:26.186254 32050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:45833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:36681
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:26.186617 32050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:26.186920 32050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:26.195595 32061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:26.195806 32059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:26.195585 32057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:26.196090 32050 server_base.cc:1034] running on GCE node
I20260812 00:00:26.196312 32050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:26.196658 32050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:26.198053 32050 hybrid_clock.cc:648] HybridClock initialized: now 1786492826198040 us; error 37 us; skew 500 ppm
Aug 12 00:00:26 dist-test-slave-vpvm krb5kdc[31652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492826, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:26.204710 32050 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:00:26.205271 32050 webserver.cc:460] Webserver started at http://127.25.103.66:41951/ using document root <none> and password file <none>
I20260812 00:00:26.205470 32050 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:26.205514 32050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:26.205614 32050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:26.206842 32050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "63f11b4aba644243bd34571a2ba77df0"
format_stamp: "Formatted at 2026-08-12 00:00:26 on dist-test-slave-vpvm"
server_key: "35d689b7f78bc46ce8f15208abd99fd8"
server_key_iv: "df72b859157eea36556a7758decc9815"
server_key_version: "encryptionkey@0"
I20260812 00:00:26.207185 32050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "63f11b4aba644243bd34571a2ba77df0"
format_stamp: "Formatted at 2026-08-12 00:00:26 on dist-test-slave-vpvm"
server_key: "35d689b7f78bc46ce8f15208abd99fd8"
server_key_iv: "df72b859157eea36556a7758decc9815"
server_key_version: "encryptionkey@0"
I20260812 00:00:26.208653 32050 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:00:26.209492 32074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:26.209709 32050 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:26.209800 32050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "63f11b4aba644243bd34571a2ba77df0"
format_stamp: "Formatted at 2026-08-12 00:00:26 on dist-test-slave-vpvm"
server_key: "35d689b7f78bc46ce8f15208abd99fd8"
server_key_iv: "df72b859157eea36556a7758decc9815"
server_key_version: "encryptionkey@0"
I20260812 00:00:26.209882 32050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:26.241744 32050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:26.244664 32050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:26.244807 32050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:26.245076 32050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:26.245388 32050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:26.245428 32050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:26.245453 32050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:26.245465 32050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:26.255481 32271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:44639 every 8 connection(s)
I20260812 00:00:26.255613 32050 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:44639
I20260812 00:00:26.256628 32050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:00:26 dist-test-slave-vpvm krb5kdc[31652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492826, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:26.265239 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 32050
I20260812 00:00:26.265348 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:00:26.265542 26013 external_mini_cluster.cc:1428] Setting key 1ffca39ddda1ee46c2db782281f3b5f2
I20260812 00:00:26.268079 31812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:26.257506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:37461 (local address 127.25.103.126:36681)
0812 00:00:26.257577 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:26.257579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:26.257703 (+ 124us) server_negotiation.cc:407] Connection header received
0812 00:00:26.258651 (+ 948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:26.258653 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:26.258667 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:26.258732 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:26.259492 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:26.260186 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:26.261384 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:26.261684 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:26.262000 (+ 316us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:26.264706 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:26.264708 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:26.264708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:26.264716 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:26.266411 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:26.266973 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:26.266974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:26.266974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:26.267035 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:26.267345 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:26.267346 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:26.267346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:26.267476 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:26.267533 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:26.267878 (+ 345us) server_negotiation.cc:299] Negotiation successful
0812 00:00:26.267974 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:00:26.268290 32274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:26.257349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:36681 (local address 127.25.103.66:37461)
0812 00:00:26.257525 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:26.257569 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:26.258503 (+ 934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:26.258844 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:26.258849 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:26.259126 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:26.259331 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:26.259335 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:26.260330 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:26.260331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:26.261200 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:26.261203 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:26.262038 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:26.262040 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:26.262235 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:26.262755 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:26.262764 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:26.264584 (+ 1820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:26.266517 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:26.266527 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:26.266530 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:26.266844 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:26.267113 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:26.267113 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:26.267114 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:26.267259 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:26.267535 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:26.267540 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:26.267719 (+ 179us) client_negotiation.cc:769] Sending connection context
0812 00:00:26.267842 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 00:00:26.268034 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":78,"threads_started":1}
I20260812 00:00:26.268721 32272 heartbeater.cc:347] Connected to a master server at 127.25.103.126:36681
I20260812 00:00:26.268816 32272 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:26.269001 32272 heartbeater.cc:511] Master 127.25.103.126:36681 requested a full tablet report, sending...
I20260812 00:00:26.269389 31714 ts_manager.cc:194] Registered new tserver with Master: 63f11b4aba644243bd34571a2ba77df0 (127.25.103.66:44639)
I20260812 00:00:26.269853 31714 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:37461
WARNING: no policy specified for kudu/127.25.103.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
I20260812 00:00:26.293152 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:36681
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:45833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:26.380102 32282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:26.380324 32282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:26.380360 32282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:26.381595 32282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:26.381641 32282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:26.381680 32282 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:00:26.383317 32282 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:45833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:36681
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32282
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:26.383563 32282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:26.383793 32282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:26.389263 32293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:26.389242 32295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:26.389242 32290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:26.389277 32282 server_base.cc:1034] running on GCE node
I20260812 00:00:26.389678 32282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:26.389889 32282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:26.391050 32282 hybrid_clock.cc:648] HybridClock initialized: now 1786492826391019 us; error 47 us; skew 500 ppm
Aug 12 00:00:26 dist-test-slave-vpvm krb5kdc[31652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492826, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:26.393730 32282 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:00:26.394241 32282 webserver.cc:460] Webserver started at http://127.25.103.67:40063/ using document root <none> and password file <none>
I20260812 00:00:26.394460 32282 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:26.394512 32282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:26.394630 32282 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:26.395869 32282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "bbd479c90de34879aa74d2cfdd8fca7c"
format_stamp: "Formatted at 2026-08-12 00:00:26 on dist-test-slave-vpvm"
server_key: "c18d878c3f00e32e0fef6d3b47802ecc"
server_key_iv: "b629c130fb220200cc14461e9e68f163"
server_key_version: "encryptionkey@0"
I20260812 00:00:26.396229 32282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "bbd479c90de34879aa74d2cfdd8fca7c"
format_stamp: "Formatted at 2026-08-12 00:00:26 on dist-test-slave-vpvm"
server_key: "c18d878c3f00e32e0fef6d3b47802ecc"
server_key_iv: "b629c130fb220200cc14461e9e68f163"
server_key_version: "encryptionkey@0"
I20260812 00:00:26.398890 32282 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260812 00:00:26.400218 32311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:26.400494 32282 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:26.400714 32282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "bbd479c90de34879aa74d2cfdd8fca7c"
format_stamp: "Formatted at 2026-08-12 00:00:26 on dist-test-slave-vpvm"
server_key: "c18d878c3f00e32e0fef6d3b47802ecc"
server_key_iv: "b629c130fb220200cc14461e9e68f163"
server_key_version: "encryptionkey@0"
I20260812 00:00:26.400972 32282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:26.416579 32282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:26.420497 32282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:26.420696 32282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:26.420979 32282 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:26.421552 32282 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:26.421787 32282 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:26.422032 32282 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:26.422214 32282 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:26.429278 32282 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:33127
I20260812 00:00:26.429337 32484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:33127 every 8 connection(s)
I20260812 00:00:26.429653 32282 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:00:26 dist-test-slave-vpvm krb5kdc[31652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492826, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:26.439653 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 32282
I20260812 00:00:26.440089 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:00:26.440316 26013 external_mini_cluster.cc:1428] Setting key eba7ada6152ac90425c547116daa04e6
I20260812 00:00:26.441215 31812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:26.430545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:59311 (local address 127.25.103.126:36681)
0812 00:00:26.430641 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:26.430643 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:26.430793 (+ 150us) server_negotiation.cc:407] Connection header received
0812 00:00:26.431762 (+ 969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:26.431763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:26.431775 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:26.431830 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:26.432469 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:26.432966 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:26.433998 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:26.434185 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:26.434242 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:26.436829 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:26.436833 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:26.436834 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:26.436845 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:26.439116 (+ 2271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:26.440008 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:26.440009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:26.440010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:26.440074 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:26.440403 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:26.440405 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:26.440405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:26.440670 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:26.440744 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:26.441037 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 00:00:26.441124 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 00:00:26.441419 32488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:26.430449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:36681 (local address 127.25.103.67:59311)
0812 00:00:26.430654 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:26.430703 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:26.431651 (+ 948us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:26.431910 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:26.431915 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:26.432187 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:26.432379 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:26.432383 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:26.433053 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:26.433055 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:26.433867 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:26.433870 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:26.434258 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:26.434259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:26.434386 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:26.434880 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:26.434891 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:26.436634 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:26.439562 (+ 2928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:26.439570 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:26.439572 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:26.439916 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:26.440141 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:26.440143 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:26.440143 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:26.440299 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:26.440755 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:26.440762 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:26.440908 (+ 146us) client_negotiation.cc:769] Sending connection context
0812 00:00:26.441001 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 00:00:26.441182 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":94,"threads_started":1}
I20260812 00:00:26.442317 32485 heartbeater.cc:347] Connected to a master server at 127.25.103.126:36681
I20260812 00:00:26.442421 32485 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:26.442581 32485 heartbeater.cc:511] Master 127.25.103.126:36681 requested a full tablet report, sending...
I20260812 00:00:26.443037 31714 ts_manager.cc:194] Registered new tserver with Master: bbd479c90de34879aa74d2cfdd8fca7c (127.25.103.67:33127)
I20260812 00:00:26.443974 31714 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:59311
I20260812 00:00:26.453243 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:00:26 dist-test-slave-vpvm krb5kdc[31652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:00:26 dist-test-slave-vpvm krb5kdc[31652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.65@KRBTEST.COM
I20260812 00:00:26.480897 32504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:26.471034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40086 (local address 127.25.103.65:33327)
0812 00:00:26.471271 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:26.471276 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:26.471288 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:00:26.471316 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:26.471318 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:26.471332 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:26.471408 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:26.472019 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:26.472788 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:26.473565 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:26.473904 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:26.474001 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:26.476416 (+ 2415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:26.476427 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:26.476427 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:26.476435 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:26.479135 (+ 2700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:26.479550 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:26.479553 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:26.479553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:26.479631 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:26.479983 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:26.479985 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:26.479985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:26.480152 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:26.480273 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:26.480697 (+ 424us) server_negotiation.cc:299] Negotiation successful
0812 00:00:26.480797 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":106,"threads_started":1}
Aug 12 00:00:26 dist-test-slave-vpvm krb5kdc[31652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:26.490502 31812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:26.482834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51984 (local address 127.25.103.126:36681)
0812 00:00:26.482890 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:26.482900 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:26.482920 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:00:26.482942 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:26.482943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:26.482952 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:26.482990 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:26.483477 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:26.484177 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:26.485066 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:26.485340 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:26.485407 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:26.487696 (+ 2289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:26.487697 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:26.487698 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:26.487705 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:26.489118 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:26.489532 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:26.489533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:26.489533 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:26.489596 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:26.489848 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:26.489849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:26.489850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:26.490109 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:26.490205 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:26.490336 (+ 131us) server_negotiation.cc:299] Negotiation successful
0812 00:00:26.490419 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260812 00:00:26.490778 31714 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51984
I20260812 00:00:26.491173 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 31825
I20260812 00:00:26.503098 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 32050
I20260812 00:00:26.538072 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 32282
I20260812 00:00:26.547049 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 31670
2026-08-12T00:00:26Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2261 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:00:26 dist-test-slave-vpvm krb5kdc[32512](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:00:26 dist-test-slave-vpvm krb5kdc[32512](info): set up 2 sockets
Aug 12 00:00:26 dist-test-slave-vpvm krb5kdc[32512](info): commencing operation
krb5kdc: starting...
W20260812 00:00:27.756454 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.188s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:00:27 dist-test-slave-vpvm krb5kdc[32512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492827, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:00:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:00:27.898185 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:45781
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:37809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:45781
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:27.988484 32529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:27.988727 32529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:27.988754 32529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:27.989996 32529 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:27.990041 32529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:27.990053 32529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:27.990064 32529 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:27.990077 32529 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:00:27.991721 32529 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:37809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:45781
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:45781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:27.991967 32529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:27.992166 32529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:27.998093 32541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:27.998093 32539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:27.998093 32543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:27.998451 32529 server_base.cc:1034] running on GCE node
I20260812 00:00:27.998962 32529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:27.999374 32529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:28.000577 32529 hybrid_clock.cc:648] HybridClock initialized: now 1786492828000554 us; error 41 us; skew 500 ppm
Aug 12 00:00:27 dist-test-slave-vpvm krb5kdc[32512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492827, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:28.003690 32529 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:00:28.004142 32529 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:28.004204 32529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:28.004339 32529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:28.005498 32529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "304997be46b84067b4f979d47017205d"
format_stamp: "Formatted at 2026-08-12 00:00:27 on dist-test-slave-vpvm"
server_key: "dc74d97dd976fd32560f463ef7a398f8"
server_key_iv: "3b25d12d2116a0241b9cc2ae221c3ab1"
server_key_version: "encryptionkey@0"
I20260812 00:00:28.005868 32529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "304997be46b84067b4f979d47017205d"
format_stamp: "Formatted at 2026-08-12 00:00:27 on dist-test-slave-vpvm"
server_key: "dc74d97dd976fd32560f463ef7a398f8"
server_key_iv: "3b25d12d2116a0241b9cc2ae221c3ab1"
server_key_version: "encryptionkey@0"
I20260812 00:00:28.007529 32529 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:00:28.008682 32555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:28.008960 32529 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:00:28.009095 32529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "304997be46b84067b4f979d47017205d"
format_stamp: "Formatted at 2026-08-12 00:00:27 on dist-test-slave-vpvm"
server_key: "dc74d97dd976fd32560f463ef7a398f8"
server_key_iv: "3b25d12d2116a0241b9cc2ae221c3ab1"
server_key_version: "encryptionkey@0"
I20260812 00:00:28.009295 32529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:28.028726 32529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:28.031100 32529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:28.031260 32529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:28.035526 32529 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:45781
I20260812 00:00:28.035570 32636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:45781 every 8 connection(s)
I20260812 00:00:28.035872 32529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:28.037074 32637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:28.039750 32637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d: Bootstrap starting.
I20260812 00:00:28.040372 32637 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:28.040649 32637 log.cc:824] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:28.041389 32637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d: No bootstrap required, opened a new log
I20260812 00:00:28.043107 32637 raft_consensus.cc:348] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "304997be46b84067b4f979d47017205d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45781 } }
I20260812 00:00:28.043298 32637 raft_consensus.cc:374] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:28.043320 32637 raft_consensus.cc:729] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 304997be46b84067b4f979d47017205d, State: Initialized, Role: FOLLOWER
I20260812 00:00:28.043449 32637 consensus_queue.cc:260] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "304997be46b84067b4f979d47017205d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45781 } }
I20260812 00:00:28.043542 32637 raft_consensus.cc:388] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:28.043567 32637 raft_consensus.cc:482] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:28.043607 32637 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:28.044530 32637 raft_consensus.cc:504] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "304997be46b84067b4f979d47017205d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45781 } }
I20260812 00:00:28.044638 32637 leader_election.cc:302] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 304997be46b84067b4f979d47017205d; no voters:
I20260812 00:00:28.044793 32637 leader_election.cc:288] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:00:28.044884 32642 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:28.045076 32637 sys_catalog.cc:564] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:28.045079 32642 raft_consensus.cc:686] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d [term 1 LEADER]: Becoming Leader. State: Replica: 304997be46b84067b4f979d47017205d, State: Running, Role: LEADER
I20260812 00:00:28.045219 32642 consensus_queue.cc:237] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "304997be46b84067b4f979d47017205d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45781 } }
I20260812 00:00:28.045804 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 32529
I20260812 00:00:28.045922 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:00:28.046047 32644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 304997be46b84067b4f979d47017205d. Latest consensus state: current_term: 1 leader_uuid: "304997be46b84067b4f979d47017205d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "304997be46b84067b4f979d47017205d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45781 } } }
I20260812 00:00:28.046139 26013 external_mini_cluster.cc:1428] Setting key f65ef357f35cd7187c256c14dd89b2d2
I20260812 00:00:28.046139 32644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:28.046489 32643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "304997be46b84067b4f979d47017205d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "304997be46b84067b4f979d47017205d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45781 } } }
I20260812 00:00:28.046566 32643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:28.046643 32659 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:28.047183 32659 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:00:28.048950 32659 catalog_manager.cc:1347] Generated new cluster ID: e804c249bfcb4c3789274a7926da9884
I20260812 00:00:28.049022 32659 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:00:28 dist-test-slave-vpvm krb5kdc[32512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492827, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:28.060266 32672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.046831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52956 (local address 127.25.103.126:45781)
0812 00:00:28.047024 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:28.047035 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:28.047072 (+ 37us) server_negotiation.cc:407] Connection header received
0812 00:00:28.047210 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:28.047217 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:28.047278 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:28.047426 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:28.048166 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.049765 (+ 1599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.051088 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.052098 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.052406 (+ 308us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.055792 (+ 3386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:28.055799 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:28.055800 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:28.055819 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:28.057982 (+ 2163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:28.058432 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:28.058436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:28.058436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:28.058574 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:28.058771 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:28.058772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:28.058772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:28.059154 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:28.059325 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:28.059405 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 00:00:28.059849 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":69,"threads_started":1}
I20260812 00:00:28.065459 32659 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:00:28.066357 32659 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:28.075105 32659 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d: Generated new TSK 0
I20260812 00:00:28.075335 32659 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
I20260812 00:00:28.109115 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:45781
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:37809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:28.204842 32679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:28.205135 32679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:28.205169 32679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:28.207408 32679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:28.207504 32679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:28.207540 32679 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:00:28.209764 32679 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:37809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:45781
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:28.210105 32679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:28.210363 32679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:28.215683 32688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:28.215703 32692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:28.215683 32689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:28.215713 32679 server_base.cc:1034] running on GCE node
I20260812 00:00:28.216076 32679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:28.216364 32679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:28.217619 32679 hybrid_clock.cc:648] HybridClock initialized: now 1786492828217587 us; error 32 us; skew 500 ppm
Aug 12 00:00:28 dist-test-slave-vpvm krb5kdc[32512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492828, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:28.221287 32679 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:00:28.221753 32679 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:28.221815 32679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:28.222009 32679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:28.223559 32679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "efaa54e6356a4dd79d8be4fff6ee54cb"
format_stamp: "Formatted at 2026-08-12 00:00:28 on dist-test-slave-vpvm"
server_key: "7719a3ccd23442ec554f7c8dee0b16f1"
server_key_iv: "176fa7e2331fa868618ddee98388f155"
server_key_version: "encryptionkey@0"
I20260812 00:00:28.224148 32679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "efaa54e6356a4dd79d8be4fff6ee54cb"
format_stamp: "Formatted at 2026-08-12 00:00:28 on dist-test-slave-vpvm"
server_key: "7719a3ccd23442ec554f7c8dee0b16f1"
server_key_iv: "176fa7e2331fa868618ddee98388f155"
server_key_version: "encryptionkey@0"
I20260812 00:00:28.226123 32679 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260812 00:00:28.227435 32704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:28.227730 32679 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:28.227864 32679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "efaa54e6356a4dd79d8be4fff6ee54cb"
format_stamp: "Formatted at 2026-08-12 00:00:28 on dist-test-slave-vpvm"
server_key: "7719a3ccd23442ec554f7c8dee0b16f1"
server_key_iv: "176fa7e2331fa868618ddee98388f155"
server_key_version: "encryptionkey@0"
I20260812 00:00:28.227962 32679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:28.235201 32679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:28.237739 32679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:28.237922 32679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:28.238212 32679 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:28.238755 32679 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:28.238823 32679 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:28.238977 32679 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:28.239012 32679 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:28.246522 32679 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:41257
I20260812 00:00:28.246611 407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:41257 every 8 connection(s)
I20260812 00:00:28.247126 32679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:00:28.256196 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 32679
I20260812 00:00:28.256325 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
Aug 12 00:00:28 dist-test-slave-vpvm krb5kdc[32512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492828, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:28.256526 26013 external_mini_cluster.cc:1428] Setting key 5d3389e6f81e68c67f6556a7c4213cdb
I20260812 00:00:28.260838 32672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.248166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:43995 (local address 127.25.103.126:45781)
0812 00:00:28.248248 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:28.248251 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:28.248560 (+ 309us) server_negotiation.cc:407] Connection header received
0812 00:00:28.249240 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:28.249242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:28.249261 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:28.249332 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:28.250704 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.251558 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.252885 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.253132 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.253191 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.257137 (+ 3946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:28.257139 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:28.257140 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:28.257155 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:28.258645 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:28.259236 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:28.259237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:28.259238 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:28.259310 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:28.259927 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:28.259928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:28.259928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:28.260093 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:28.260171 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:28.260630 (+ 459us) server_negotiation.cc:299] Negotiation successful
0812 00:00:28.260733 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 00:00:28.261047 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.248143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:45781 (local address 127.25.103.65:43995)
0812 00:00:28.248382 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:28.248435 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:28.249128 (+ 693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:28.249413 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:28.249417 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:28.249835 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:28.250577 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:28.250586 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.251694 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.251695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:28.252784 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:28.252788 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.253225 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.253226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:28.253380 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.254968 (+ 1588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:28.254980 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:28.257003 (+ 2023us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:28.258745 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:28.258758 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:28.258761 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:28.259137 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:28.259466 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:28.259469 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:28.259469 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:28.259808 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:28.260213 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:28.260224 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:28.260441 (+ 217us) client_negotiation.cc:769] Sending connection context
0812 00:00:28.260577 (+ 136us) client_negotiation.cc:240] Negotiation successful
0812 00:00:28.260782 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":133,"threads_started":1}
I20260812 00:00:28.261754 408 heartbeater.cc:347] Connected to a master server at 127.25.103.126:45781
I20260812 00:00:28.261914 408 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:28.262169 408 heartbeater.cc:511] Master 127.25.103.126:45781 requested a full tablet report, sending...
I20260812 00:00:28.263093 32586 ts_manager.cc:194] Registered new tserver with Master: efaa54e6356a4dd79d8be4fff6ee54cb (127.25.103.65:41257)
I20260812 00:00:28.264304 32586 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:43995
WARNING: no policy specified for kudu/127.25.103.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
I20260812 00:00:28.287420 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:45781
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:37809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:28.380640 413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:28.380889 413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:28.380916 413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:28.383143 413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:28.383265 413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:28.383306 413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:00:28.385804 413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:37809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:45781
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.413
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:28.386171 413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:28.386411 413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:28.392184 425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:28.392197 427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:28.392215 424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:28.392549 413 server_base.cc:1034] running on GCE node
I20260812 00:00:28.392844 413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:28.393177 413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:28.394379 413 hybrid_clock.cc:648] HybridClock initialized: now 1786492828394355 us; error 43 us; skew 500 ppm
Aug 12 00:00:28 dist-test-slave-vpvm krb5kdc[32512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492828, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:28.397331 413 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:00:28.397774 413 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:28.397833 413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:28.398025 413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:28.399338 413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "1152f3788c644aac96e1d78e0195e271"
format_stamp: "Formatted at 2026-08-12 00:00:28 on dist-test-slave-vpvm"
server_key: "11a631c5a048be75ba64eb3dae0a218f"
server_key_iv: "99664816e85d35da3e7cbe9d8eefd580"
server_key_version: "encryptionkey@0"
I20260812 00:00:28.399736 413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "1152f3788c644aac96e1d78e0195e271"
format_stamp: "Formatted at 2026-08-12 00:00:28 on dist-test-slave-vpvm"
server_key: "11a631c5a048be75ba64eb3dae0a218f"
server_key_iv: "99664816e85d35da3e7cbe9d8eefd580"
server_key_version: "encryptionkey@0"
I20260812 00:00:28.401422 413 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:00:28.402669 436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:28.403002 413 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:28.403155 413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "1152f3788c644aac96e1d78e0195e271"
format_stamp: "Formatted at 2026-08-12 00:00:28 on dist-test-slave-vpvm"
server_key: "11a631c5a048be75ba64eb3dae0a218f"
server_key_iv: "99664816e85d35da3e7cbe9d8eefd580"
server_key_version: "encryptionkey@0"
I20260812 00:00:28.403246 413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:28.414507 413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:28.416985 413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:28.417155 413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:28.417450 413 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:28.417825 413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:28.417863 413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:28.417898 413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:28.417919 413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:28.425601 413 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:41219
I20260812 00:00:28.425696 604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:41219 every 8 connection(s)
I20260812 00:00:28.426007 413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:00:28 dist-test-slave-vpvm krb5kdc[32512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492828, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:28.435240 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 413
I20260812 00:00:28.435343 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:00:28.435562 26013 external_mini_cluster.cc:1428] Setting key 3b8c1bef8a62945f904ec11784200ba5
I20260812 00:00:28.438031 32672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.426920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:46345 (local address 127.25.103.126:45781)
0812 00:00:28.427028 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:28.427030 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:28.427270 (+ 240us) server_negotiation.cc:407] Connection header received
0812 00:00:28.428080 (+ 810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:28.428082 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:28.428095 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:28.428170 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:28.429416 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.429987 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.431161 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.431412 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.431494 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.434599 (+ 3105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:28.434601 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:28.434601 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:28.434610 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:28.436532 (+ 1922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:28.436999 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:28.437000 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:28.437001 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:28.437066 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:28.437305 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:28.437305 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:28.437306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:28.437438 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:28.437497 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:28.437800 (+ 303us) server_negotiation.cc:299] Negotiation successful
0812 00:00:28.437903 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:00:28.438575 610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.426841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:45781 (local address 127.25.103.66:46345)
0812 00:00:28.427079 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:28.427124 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:28.427884 (+ 760us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:28.428351 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:28.428357 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:28.428690 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:28.429288 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:28.429296 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.430103 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.430104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:28.431026 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:28.431031 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.431552 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.431554 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:28.431740 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.432645 (+ 905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:28.432657 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:28.434448 (+ 1791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:28.436622 (+ 2174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:28.436635 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:28.436639 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:28.436921 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:28.437123 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:28.437124 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:28.437125 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:28.437246 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:28.437496 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:28.437504 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:28.437669 (+ 165us) client_negotiation.cc:769] Sending connection context
0812 00:00:28.437768 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 00:00:28.437990 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":137,"threads_started":1}
I20260812 00:00:28.439203 605 heartbeater.cc:347] Connected to a master server at 127.25.103.126:45781
I20260812 00:00:28.439311 605 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:28.439489 605 heartbeater.cc:511] Master 127.25.103.126:45781 requested a full tablet report, sending...
I20260812 00:00:28.439893 32586 ts_manager.cc:194] Registered new tserver with Master: 1152f3788c644aac96e1d78e0195e271 (127.25.103.66:41219)
I20260812 00:00:28.440284 32586 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:46345
WARNING: no policy specified for kudu/127.25.103.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
I20260812 00:00:28.464572 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:45781
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:37809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:28.560643 615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:28.560882 615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:28.560910 615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:28.562314 615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:28.562371 615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:28.562403 615 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:00:28.564203 615 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:37809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:45781
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.615
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:28.564460 615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:28.564730 615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:28.570065 622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:28.570065 627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:28.570065 621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:28.570415 615 server_base.cc:1034] running on GCE node
I20260812 00:00:28.570660 615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:28.570946 615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:28.572116 615 hybrid_clock.cc:648] HybridClock initialized: now 1786492828572097 us; error 32 us; skew 500 ppm
Aug 12 00:00:28 dist-test-slave-vpvm krb5kdc[32512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492828, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:28.574908 615 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:00:28.575439 615 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:28.575502 615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:28.575666 615 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:28.576807 615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "138c510d0dcf42b3bd4c4350ad4bd57d"
format_stamp: "Formatted at 2026-08-12 00:00:28 on dist-test-slave-vpvm"
server_key: "ad7000aa42beb9436815aba08cf1caa0"
server_key_iv: "13b679977c72fa55faa774a3b60cdbf7"
server_key_version: "encryptionkey@0"
I20260812 00:00:28.577124 615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "138c510d0dcf42b3bd4c4350ad4bd57d"
format_stamp: "Formatted at 2026-08-12 00:00:28 on dist-test-slave-vpvm"
server_key: "ad7000aa42beb9436815aba08cf1caa0"
server_key_iv: "13b679977c72fa55faa774a3b60cdbf7"
server_key_version: "encryptionkey@0"
I20260812 00:00:28.578781 615 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20260812 00:00:28.579806 638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:28.580025 615 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:28.580124 615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "138c510d0dcf42b3bd4c4350ad4bd57d"
format_stamp: "Formatted at 2026-08-12 00:00:28 on dist-test-slave-vpvm"
server_key: "ad7000aa42beb9436815aba08cf1caa0"
server_key_iv: "13b679977c72fa55faa774a3b60cdbf7"
server_key_version: "encryptionkey@0"
I20260812 00:00:28.580196 615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:28.596863 615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:28.599184 615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:28.599339 615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:28.599596 615 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:28.599942 615 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:28.599984 615 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:28.600015 615 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:28.600039 615 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:28.606937 615 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:46467
I20260812 00:00:28.607016 805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:46467 every 8 connection(s)
I20260812 00:00:28.607379 615 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:00:28.612646 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 615
I20260812 00:00:28.612908 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:00:28.613205 26013 external_mini_cluster.cc:1428] Setting key 875a2a8068949369423f818aa6dbe08a
Aug 12 00:00:28 dist-test-slave-vpvm krb5kdc[32512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492828, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:28.618687 32672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.608325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:56607 (local address 127.25.103.126:45781)
0812 00:00:28.608379 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:28.608382 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:28.608558 (+ 176us) server_negotiation.cc:407] Connection header received
0812 00:00:28.609205 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:28.609208 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:28.609226 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:28.609321 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:28.610634 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.611148 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.612809 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.613100 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.613202 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.615866 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:28.615867 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:28.615868 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:28.615875 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:28.617195 (+ 1320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:28.617734 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:28.617736 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:28.617736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:28.617801 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:28.618076 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:28.618077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:28.618077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:28.618202 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:28.618256 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:28.618528 (+ 272us) server_negotiation.cc:299] Negotiation successful
0812 00:00:28.618616 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:00:28.618834 811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.608234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:45781 (local address 127.25.103.67:56607)
0812 00:00:28.608425 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:28.608471 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:28.608986 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:28.609397 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:28.609401 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:28.609727 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:28.610464 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:28.610474 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.611310 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.611312 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:28.612653 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:28.612658 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.613254 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.613257 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:28.613486 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.614147 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:28.614157 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:28.615748 (+ 1591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:28.617389 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:28.617396 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:28.617399 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:28.617631 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:28.617865 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:28.617865 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:28.617865 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:28.618026 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:28.618246 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:28.618249 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:28.618388 (+ 139us) client_negotiation.cc:769] Sending connection context
0812 00:00:28.618471 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 00:00:28.618619 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":119,"threads_started":1}
I20260812 00:00:28.619338 807 heartbeater.cc:347] Connected to a master server at 127.25.103.126:45781
I20260812 00:00:28.619442 807 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:28.619601 807 heartbeater.cc:511] Master 127.25.103.126:45781 requested a full tablet report, sending...
I20260812 00:00:28.620018 32586 ts_manager.cc:194] Registered new tserver with Master: 138c510d0dcf42b3bd4c4350ad4bd57d (127.25.103.67:46467)
I20260812 00:00:28.620404 32586 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:56607
I20260812 00:00:28.625818 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:00:28.634961 32672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.627256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52962 (local address 127.25.103.126:45781)
0812 00:00:28.627315 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:28.627317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:28.627398 (+ 81us) server_negotiation.cc:407] Connection header received
0812 00:00:28.627461 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:28.627462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:28.627472 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:28.627513 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:28.628373 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.628937 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.629876 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.630166 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.630240 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.631696 (+ 1456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:28.631698 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:28.631698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:28.631749 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:28.633345 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:28.633843 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:28.633844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:28.633844 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:28.633930 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:28.634252 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:28.634253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:28.634254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:28.634468 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:28.634578 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:28.634733 (+ 155us) server_negotiation.cc:299] Negotiation successful
0812 00:00:28.634846 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:00:28.637456 32586 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52962:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:00:28.639204 32586 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:00:28.647686 833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.642781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:41219 (local address 127.0.0.1:46206)
0812 00:00:28.642918 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:28.642929 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:28.642970 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:28.643581 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:28.643582 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:28.643585 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:28.643633 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:28.643635 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.644692 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.644693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:28.646247 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:28.646251 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.647313 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.647314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:28.647406 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.647423 (+ 17us) client_negotiation.cc:769] Sending connection context
0812 00:00:28.647491 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 00:00:28.647574 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":87,"thread_start_us":84,"threads_started":1}
I20260812 00:00:28.647856 829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.642623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33484 (local address 127.25.103.67:46467)
0812 00:00:28.642825 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:28.642830 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:28.643278 (+ 448us) server_negotiation.cc:407] Connection header received
0812 00:00:28.643333 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:28.643336 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:28.643355 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:28.643435 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:28.643720 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.644912 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.646653 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.647321 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.647462 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.647552 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:28.647683 (+ 131us) server_negotiation.cc:299] Negotiation successful
0812 00:00:28.647753 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":101,"threads_started":1}
I20260812 00:00:28.647912 825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.642489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:46467 (local address 127.0.0.1:33484)
0812 00:00:28.642907 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:28.642921 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:28.643003 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:28.643538 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:28.643540 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:28.643543 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:28.643635 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:28.643638 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.645123 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.645124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:28.646545 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:28.646547 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.647488 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.647490 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:28.647588 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.647595 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 00:00:28.647656 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 00:00:28.647725 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"mutex_wait_us":1,"thread_start_us":165,"threads_started":1}
I20260812 00:00:28.648480 824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.642478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:41257 (local address 127.0.0.1:39762)
0812 00:00:28.642689 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:28.642735 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:28.642809 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:28.643394 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:28.643398 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:28.643401 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:28.643507 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:28.643510 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.645265 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.645266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:28.646518 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:28.646522 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.647579 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.647581 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:28.648292 (+ 711us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.648298 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:00:28.648348 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 00:00:28.648400 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":91,"threads_started":1}
I20260812 00:00:28.648662 710 tablet_service.cc:1467] Processing CreateTablet for tablet b8426ed7dc254ca19b01cb414ac2804e (DEFAULT_TABLE table=test-table [id=99d08102de8e4f4b8b6af9c693c022c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:28.648794 835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.643082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46206 (local address 127.25.103.66:41219)
0812 00:00:28.643320 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:28.643324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:28.643335 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:00:28.643378 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:28.643379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:28.643396 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:28.643481 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:28.643788 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.644591 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.646362 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.647120 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.647197 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.647271 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:28.648518 (+ 1247us) server_negotiation.cc:299] Negotiation successful
0812 00:00:28.648704 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":119,"threads_started":1}
I20260812 00:00:28.648794 831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.642686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39762 (local address 127.25.103.65:41257)
0812 00:00:28.643082 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:28.643088 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:28.643100 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:00:28.643162 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:28.643164 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:28.643180 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:28.643268 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:28.643619 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.644912 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.646642 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.647418 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.647491 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.647545 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:28.648640 (+ 1095us) server_negotiation.cc:299] Negotiation successful
0812 00:00:28.648696 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":109,"threads_started":1}
I20260812 00:00:28.649072 710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8426ed7dc254ca19b01cb414ac2804e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:28.649542 511 tablet_service.cc:1467] Processing CreateTablet for tablet b8426ed7dc254ca19b01cb414ac2804e (DEFAULT_TABLE table=test-table [id=99d08102de8e4f4b8b6af9c693c022c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:28.650185 511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8426ed7dc254ca19b01cb414ac2804e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:28.652240 836 tablet_bootstrap.cc:492] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d: Bootstrap starting.
I20260812 00:00:28.652987 836 tablet_bootstrap.cc:654] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:28.653002 313 tablet_service.cc:1467] Processing CreateTablet for tablet b8426ed7dc254ca19b01cb414ac2804e (DEFAULT_TABLE table=test-table [id=99d08102de8e4f4b8b6af9c693c022c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:28.653394 313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8426ed7dc254ca19b01cb414ac2804e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:28.653746 836 log.cc:824] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:28.654682 836 tablet_bootstrap.cc:492] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d: No bootstrap required, opened a new log
I20260812 00:00:28.654762 836 ts_tablet_manager.cc:1397] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 00:00:28.656821 836 raft_consensus.cc:348] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "138c510d0dcf42b3bd4c4350ad4bd57d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 46467 } } peers { permanent_uuid: "efaa54e6356a4dd79d8be4fff6ee54cb" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41257 } } peers { permanent_uuid: "1152f3788c644aac96e1d78e0195e271" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41219 } }
I20260812 00:00:28.656930 842 tablet_bootstrap.cc:492] T b8426ed7dc254ca19b01cb414ac2804e P efaa54e6356a4dd79d8be4fff6ee54cb: Bootstrap starting.
I20260812 00:00:28.657004 836 raft_consensus.cc:374] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:28.657052 836 raft_consensus.cc:729] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 138c510d0dcf42b3bd4c4350ad4bd57d, State: Initialized, Role: FOLLOWER
I20260812 00:00:28.657176 836 consensus_queue.cc:260] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "138c510d0dcf42b3bd4c4350ad4bd57d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 46467 } } peers { permanent_uuid: "efaa54e6356a4dd79d8be4fff6ee54cb" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41257 } } peers { permanent_uuid: "1152f3788c644aac96e1d78e0195e271" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41219 } }
I20260812 00:00:28.657701 842 tablet_bootstrap.cc:654] T b8426ed7dc254ca19b01cb414ac2804e P efaa54e6356a4dd79d8be4fff6ee54cb: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:28.657649 836 ts_tablet_manager.cc:1428] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:00:28.657646 807 heartbeater.cc:503] Master 127.25.103.126:45781 was elected leader, sending a full tablet report...
I20260812 00:00:28.657922 840 tablet_bootstrap.cc:492] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271: Bootstrap starting.
I20260812 00:00:28.658725 842 log.cc:824] T b8426ed7dc254ca19b01cb414ac2804e P efaa54e6356a4dd79d8be4fff6ee54cb: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:28.658860 840 tablet_bootstrap.cc:654] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:28.659785 842 tablet_bootstrap.cc:492] T b8426ed7dc254ca19b01cb414ac2804e P efaa54e6356a4dd79d8be4fff6ee54cb: No bootstrap required, opened a new log
I20260812 00:00:28.659854 842 ts_tablet_manager.cc:1397] T b8426ed7dc254ca19b01cb414ac2804e P efaa54e6356a4dd79d8be4fff6ee54cb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:00:28.659849 840 log.cc:824] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:28.660620 840 tablet_bootstrap.cc:492] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271: No bootstrap required, opened a new log
I20260812 00:00:28.660683 840 ts_tablet_manager.cc:1397] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260812 00:00:28.661548 842 raft_consensus.cc:348] T b8426ed7dc254ca19b01cb414ac2804e P efaa54e6356a4dd79d8be4fff6ee54cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "138c510d0dcf42b3bd4c4350ad4bd57d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 46467 } } peers { permanent_uuid: "efaa54e6356a4dd79d8be4fff6ee54cb" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41257 } } peers { permanent_uuid: "1152f3788c644aac96e1d78e0195e271" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41219 } }
I20260812 00:00:28.661710 842 raft_consensus.cc:374] T b8426ed7dc254ca19b01cb414ac2804e P efaa54e6356a4dd79d8be4fff6ee54cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:28.661748 842 raft_consensus.cc:729] T b8426ed7dc254ca19b01cb414ac2804e P efaa54e6356a4dd79d8be4fff6ee54cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efaa54e6356a4dd79d8be4fff6ee54cb, State: Initialized, Role: FOLLOWER
I20260812 00:00:28.661873 842 consensus_queue.cc:260] T b8426ed7dc254ca19b01cb414ac2804e P efaa54e6356a4dd79d8be4fff6ee54cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "138c510d0dcf42b3bd4c4350ad4bd57d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 46467 } } peers { permanent_uuid: "efaa54e6356a4dd79d8be4fff6ee54cb" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41257 } } peers { permanent_uuid: "1152f3788c644aac96e1d78e0195e271" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41219 } }
I20260812 00:00:28.662205 842 ts_tablet_manager.cc:1428] T b8426ed7dc254ca19b01cb414ac2804e P efaa54e6356a4dd79d8be4fff6ee54cb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:00:28.662359 408 heartbeater.cc:503] Master 127.25.103.126:45781 was elected leader, sending a full tablet report...
I20260812 00:00:28.663326 840 raft_consensus.cc:348] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "138c510d0dcf42b3bd4c4350ad4bd57d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 46467 } } peers { permanent_uuid: "efaa54e6356a4dd79d8be4fff6ee54cb" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41257 } } peers { permanent_uuid: "1152f3788c644aac96e1d78e0195e271" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41219 } }
I20260812 00:00:28.663535 840 raft_consensus.cc:374] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:28.663569 840 raft_consensus.cc:729] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1152f3788c644aac96e1d78e0195e271, State: Initialized, Role: FOLLOWER
I20260812 00:00:28.663720 840 consensus_queue.cc:260] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "138c510d0dcf42b3bd4c4350ad4bd57d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 46467 } } peers { permanent_uuid: "efaa54e6356a4dd79d8be4fff6ee54cb" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41257 } } peers { permanent_uuid: "1152f3788c644aac96e1d78e0195e271" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41219 } }
I20260812 00:00:28.664075 840 ts_tablet_manager.cc:1428] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260812 00:00:28.664119 605 heartbeater.cc:503] Master 127.25.103.126:45781 was elected leader, sending a full tablet report...
W20260812 00:00:28.676664 607 tablet.cc:2369] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:00:28.748149 409 tablet.cc:2369] T b8426ed7dc254ca19b01cb414ac2804e P efaa54e6356a4dd79d8be4fff6ee54cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:00:28.797533 844 raft_consensus.cc:482] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:00:28.797683 844 raft_consensus.cc:504] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "138c510d0dcf42b3bd4c4350ad4bd57d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 46467 } } peers { permanent_uuid: "efaa54e6356a4dd79d8be4fff6ee54cb" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41257 } } peers { permanent_uuid: "1152f3788c644aac96e1d78e0195e271" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41219 } }
I20260812 00:00:28.798138 844 leader_election.cc:288] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efaa54e6356a4dd79d8be4fff6ee54cb (127.25.103.65:41257), 1152f3788c644aac96e1d78e0195e271 (127.25.103.66:41219)
I20260812 00:00:28.800997 835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.798417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:36729 (local address 127.25.103.66:41219)
0812 00:00:28.798463 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:28.798465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:28.798475 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:00:28.798538 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:28.798539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:28.798549 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:28.798600 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:28.798774 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.799284 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.800267 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.800665 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.800731 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.800741 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:28.800873 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 00:00:28.800917 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:00:28.801010 831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.798402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:54367 (local address 127.25.103.65:41257)
0812 00:00:28.798463 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:28.798465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:28.798701 (+ 236us) server_negotiation.cc:407] Connection header received
0812 00:00:28.798734 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:28.798735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:28.798745 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:28.798791 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:28.798926 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.799389 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.800325 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.800693 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.800753 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.800762 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:28.800903 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 00:00:28.800940 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:00:28.800997 811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.798337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:41219 (local address 127.25.103.67:36729)
0812 00:00:28.798408 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:28.798420 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:28.798471 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:28.798623 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:28.798624 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:28.798626 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:28.798692 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:28.798694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.799362 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.799363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:28.800170 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:28.800173 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.800737 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.800738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:28.800814 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.800817 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:00:28.800862 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 00:00:28.800908 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 00:00:28.801016 854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.798348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:41257 (local address 127.25.103.67:54367)
0812 00:00:28.798625 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:28.798634 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:28.798684 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:28.798792 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:28.798793 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:28.798794 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:28.798865 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:28.798866 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.799461 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.799462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:28.800237 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:28.800239 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.800760 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.800761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:28.800833 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.800836 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:00:28.800881 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 00:00:28.800924 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":61,"thread_start_us":152,"threads_started":1}
I20260812 00:00:28.801384 543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8426ed7dc254ca19b01cb414ac2804e" candidate_uuid: "138c510d0dcf42b3bd4c4350ad4bd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1152f3788c644aac96e1d78e0195e271" is_pre_election: true
I20260812 00:00:28.801384 344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8426ed7dc254ca19b01cb414ac2804e" candidate_uuid: "138c510d0dcf42b3bd4c4350ad4bd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efaa54e6356a4dd79d8be4fff6ee54cb" is_pre_election: true
I20260812 00:00:28.801560 344 raft_consensus.cc:2454] T b8426ed7dc254ca19b01cb414ac2804e P efaa54e6356a4dd79d8be4fff6ee54cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 138c510d0dcf42b3bd4c4350ad4bd57d in term 0.
I20260812 00:00:28.801560 543 raft_consensus.cc:2454] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 138c510d0dcf42b3bd4c4350ad4bd57d in term 0.
I20260812 00:00:28.801795 639 leader_election.cc:302] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 138c510d0dcf42b3bd4c4350ad4bd57d, efaa54e6356a4dd79d8be4fff6ee54cb; no voters:
I20260812 00:00:28.801927 844 raft_consensus.cc:2781] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:00:28.802012 844 raft_consensus.cc:482] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:00:28.802033 844 raft_consensus.cc:3037] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:28.802770 844 raft_consensus.cc:504] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "138c510d0dcf42b3bd4c4350ad4bd57d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 46467 } } peers { permanent_uuid: "efaa54e6356a4dd79d8be4fff6ee54cb" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41257 } } peers { permanent_uuid: "1152f3788c644aac96e1d78e0195e271" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41219 } }
I20260812 00:00:28.802919 844 leader_election.cc:288] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [CANDIDATE]: Term 1 election: Requested vote from peers efaa54e6356a4dd79d8be4fff6ee54cb (127.25.103.65:41257), 1152f3788c644aac96e1d78e0195e271 (127.25.103.66:41219)
I20260812 00:00:28.803112 344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8426ed7dc254ca19b01cb414ac2804e" candidate_uuid: "138c510d0dcf42b3bd4c4350ad4bd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efaa54e6356a4dd79d8be4fff6ee54cb"
I20260812 00:00:28.803203 344 raft_consensus.cc:3037] T b8426ed7dc254ca19b01cb414ac2804e P efaa54e6356a4dd79d8be4fff6ee54cb [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:28.803282 543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8426ed7dc254ca19b01cb414ac2804e" candidate_uuid: "138c510d0dcf42b3bd4c4350ad4bd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1152f3788c644aac96e1d78e0195e271"
I20260812 00:00:28.803435 543 raft_consensus.cc:3037] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:28.804018 344 raft_consensus.cc:2454] T b8426ed7dc254ca19b01cb414ac2804e P efaa54e6356a4dd79d8be4fff6ee54cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 138c510d0dcf42b3bd4c4350ad4bd57d in term 1.
I20260812 00:00:28.804234 639 leader_election.cc:302] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 138c510d0dcf42b3bd4c4350ad4bd57d, efaa54e6356a4dd79d8be4fff6ee54cb; no voters:
I20260812 00:00:28.804366 844 raft_consensus.cc:2781] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:28.804559 844 raft_consensus.cc:686] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [term 1 LEADER]: Becoming Leader. State: Replica: 138c510d0dcf42b3bd4c4350ad4bd57d, State: Running, Role: LEADER
I20260812 00:00:28.804664 844 consensus_queue.cc:237] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "138c510d0dcf42b3bd4c4350ad4bd57d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 46467 } } peers { permanent_uuid: "efaa54e6356a4dd79d8be4fff6ee54cb" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41257 } } peers { permanent_uuid: "1152f3788c644aac96e1d78e0195e271" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41219 } }
I20260812 00:00:28.804760 543 raft_consensus.cc:2454] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 138c510d0dcf42b3bd4c4350ad4bd57d in term 1.
I20260812 00:00:28.805704 32585 catalog_manager.cc:5495] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 138c510d0dcf42b3bd4c4350ad4bd57d (127.25.103.67). New cstate: current_term: 1 leader_uuid: "138c510d0dcf42b3bd4c4350ad4bd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "138c510d0dcf42b3bd4c4350ad4bd57d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efaa54e6356a4dd79d8be4fff6ee54cb" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1152f3788c644aac96e1d78e0195e271" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41219 } health_report { overall_health: UNKNOWN } } }
I20260812 00:00:28.833266 829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.830730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43624 (local address 127.25.103.67:46467)
0812 00:00:28.830781 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:28.830782 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:28.830791 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:28.830829 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:28.830829 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:28.830848 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:28.830912 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:28.831026 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.831532 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.832476 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:28.832672 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:28.832730 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:28.832888 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:28.833008 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:28.833085 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:28.833123 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 00:00:28.833146 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:00:28.835579 344 raft_consensus.cc:1261] T b8426ed7dc254ca19b01cb414ac2804e P efaa54e6356a4dd79d8be4fff6ee54cb [term 1 FOLLOWER]: Refusing update from remote peer 138c510d0dcf42b3bd4c4350ad4bd57d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:28.835897 543 raft_consensus.cc:1261] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271 [term 1 FOLLOWER]: Refusing update from remote peer 138c510d0dcf42b3bd4c4350ad4bd57d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:28.835971 844 consensus_queue.cc:1035] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efaa54e6356a4dd79d8be4fff6ee54cb" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:28.836179 844 consensus_queue.cc:1035] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1152f3788c644aac96e1d78e0195e271" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:28.838547 859 mvcc.cc:205] Tried to move back new op lower bound from 7317474626906472448 to 7317474626784649216. Current Snapshot: MvccSnapshot[applied={T|T < 7317474626906472448}]
I20260812 00:00:28.839738 864 mvcc.cc:205] Tried to move back new op lower bound from 7317474626906472448 to 7317474626784649216. Current Snapshot: MvccSnapshot[applied={T|T < 7317474626906472448}]
I20260812 00:00:28.842653 32586 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52962:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:28.842783 32586 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52962:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:28.843971 32586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 304997be46b84067b4f979d47017205d: Sending DeleteTablet for 3 replicas of tablet b8426ed7dc254ca19b01cb414ac2804e
I20260812 00:00:28.844553 313 tablet_service.cc:1514] Processing DeleteTablet for tablet b8426ed7dc254ca19b01cb414ac2804e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:28 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:39762
I20260812 00:00:28.844930 511 tablet_service.cc:1514] Processing DeleteTablet for tablet b8426ed7dc254ca19b01cb414ac2804e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:28 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:46206
I20260812 00:00:28.844964 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 32679
I20260812 00:00:28.845191 710 tablet_service.cc:1514] Processing DeleteTablet for tablet b8426ed7dc254ca19b01cb414ac2804e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:28 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:33484
I20260812 00:00:28.857434 876 tablet_replica.cc:330] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271: stopping tablet replica
I20260812 00:00:28.857666 876 raft_consensus.cc:2229] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:28.857836 876 raft_consensus.cc:2258] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:28.862429 876 ts_tablet_manager.cc:1905] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:28.864319 876 ts_tablet_manager.cc:1918] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:00:28.864434 876 log.cc:1196] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/b8426ed7dc254ca19b01cb414ac2804e
I20260812 00:00:28.864725 876 ts_tablet_manager.cc:1939] T b8426ed7dc254ca19b01cb414ac2804e P 1152f3788c644aac96e1d78e0195e271: Deleting consensus metadata
I20260812 00:00:28.865337 32561 catalog_manager.cc:4841] TS 1152f3788c644aac96e1d78e0195e271 (127.25.103.66:41219): tablet b8426ed7dc254ca19b01cb414ac2804e (table test-table [id=99d08102de8e4f4b8b6af9c693c022c2]) successfully deleted
I20260812 00:00:28.865801 878 tablet_replica.cc:330] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d: stopping tablet replica
I20260812 00:00:28.865983 878 raft_consensus.cc:2229] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:00:28.866196 878 raft_consensus.cc:2258] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:28.866806 878 ts_tablet_manager.cc:1905] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:28.868700 878 ts_tablet_manager.cc:1918] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:00:28.868784 878 log.cc:1196] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/b8426ed7dc254ca19b01cb414ac2804e
I20260812 00:00:28.869304 878 ts_tablet_manager.cc:1939] T b8426ed7dc254ca19b01cb414ac2804e P 138c510d0dcf42b3bd4c4350ad4bd57d: Deleting consensus metadata
I20260812 00:00:28.870080 32561 catalog_manager.cc:4841] TS 138c510d0dcf42b3bd4c4350ad4bd57d (127.25.103.67:46467): tablet b8426ed7dc254ca19b01cb414ac2804e (table test-table [id=99d08102de8e4f4b8b6af9c693c022c2]) successfully deleted
W20260812 00:00:28.872219 32558 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.103.65:41257 (error 108)
I20260812 00:00:28.872514 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 413
I20260812 00:00:28.878728 824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:28.878440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:41257 (local address 127.0.0.1:40546)
0812 00:00:28.878547 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:28.878650 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:41257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260812 00:00:28.878990 32558 catalog_manager.cc:4584] TS efaa54e6356a4dd79d8be4fff6ee54cb (127.25.103.65:41257): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b8426ed7dc254ca19b01cb414ac2804e: Network error: Client connection negotiation failed: client connection to 127.25.103.65:41257: connect: Connection refused (error 111)
I20260812 00:00:28.896538 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 615
I20260812 00:00:28.911794 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 32529
2026-08-12T00:00:28Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2380 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T00:00:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:28Z Disabled control of system clock
I20260812 00:00:28.959671 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:34431
--webserver_interface=127.25.103.126
--webserver_port=0
--builtin_ntp_servers=127.25.103.84:40241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:34431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 00:00:29.053531 889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:29.053807 889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:29.053829 889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:29.055128 889 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:29.055195 889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:29.055207 889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:29.055219 889 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:29.055230 889 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:00:29.056782 889 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:40241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:34431
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:34431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:29.057039 889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:29.057322 889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:29.062716 899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:29.062733 898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:29.062762 902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:29.063242 889 server_base.cc:1034] running on GCE node
I20260812 00:00:29.063558 889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:29.063925 889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:29.065104 889 hybrid_clock.cc:648] HybridClock initialized: now 1786492829065089 us; error 35 us; skew 500 ppm
I20260812 00:00:29.066843 889 webserver.cc:460] Webserver started at http://127.25.103.126:40915/ using document root <none> and password file <none>
I20260812 00:00:29.067109 889 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:29.067351 889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:29.067665 889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:29.068917 889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "570e1329f615442d8be94026caf56516"
format_stamp: "Formatted at 2026-08-12 00:00:29 on dist-test-slave-vpvm"
server_key: "816b67786bc4370ef0b5a2c66a081672"
server_key_iv: "80ee8b1f60057dcec234e09c4e8389cd"
server_key_version: "encryptionkey@0"
I20260812 00:00:29.069300 889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "570e1329f615442d8be94026caf56516"
format_stamp: "Formatted at 2026-08-12 00:00:29 on dist-test-slave-vpvm"
server_key: "816b67786bc4370ef0b5a2c66a081672"
server_key_iv: "80ee8b1f60057dcec234e09c4e8389cd"
server_key_version: "encryptionkey@0"
I20260812 00:00:29.070988 889 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260812 00:00:29.071939 911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:29.072196 889 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:00:29.072302 889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "570e1329f615442d8be94026caf56516"
format_stamp: "Formatted at 2026-08-12 00:00:29 on dist-test-slave-vpvm"
server_key: "816b67786bc4370ef0b5a2c66a081672"
server_key_iv: "80ee8b1f60057dcec234e09c4e8389cd"
server_key_version: "encryptionkey@0"
I20260812 00:00:29.072388 889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:29.076910 889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:29.077229 889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:29.077371 889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:29.082504 889 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:34431
I20260812 00:00:29.082566 987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:34431 every 8 connection(s)
I20260812 00:00:29.082996 889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:29.083962 988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:29.087074 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 889
I20260812 00:00:29.087193 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:00:29.087301 988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516: Bootstrap starting.
I20260812 00:00:29.087419 26013 external_mini_cluster.cc:1428] Setting key ab414d5241ee1d24da9f88ec40223c58
I20260812 00:00:29.088250 988 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:29.088618 988 log.cc:824] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:29.089783 988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516: No bootstrap required, opened a new log
I20260812 00:00:29.090811 995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.088127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53136 (local address 127.25.103.126:34431)
0812 00:00:29.088435 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:29.088446 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:29.088497 (+ 51us) server_negotiation.cc:407] Connection header received
0812 00:00:29.089088 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:29.089100 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:29.089159 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:29.089310 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:29.090221 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:29.090225 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:29.090226 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:00:29.090230 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:29.090280 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:00:29.090291 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:29.090378 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:29.090445 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 00:00:29.090503 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":83,"threads_started":1}
I20260812 00:00:29.092532 988 raft_consensus.cc:348] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "570e1329f615442d8be94026caf56516" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 34431 } }
I20260812 00:00:29.092731 988 raft_consensus.cc:374] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:29.092767 988 raft_consensus.cc:729] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 570e1329f615442d8be94026caf56516, State: Initialized, Role: FOLLOWER
I20260812 00:00:29.092909 988 consensus_queue.cc:260] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "570e1329f615442d8be94026caf56516" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 34431 } }
I20260812 00:00:29.093004 988 raft_consensus.cc:388] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:29.093039 988 raft_consensus.cc:482] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:29.093092 988 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:29.094280 988 raft_consensus.cc:504] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "570e1329f615442d8be94026caf56516" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 34431 } }
I20260812 00:00:29.094401 988 leader_election.cc:302] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 570e1329f615442d8be94026caf56516; no voters:
I20260812 00:00:29.094596 988 leader_election.cc:288] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:00:29.094736 998 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:29.094965 988 sys_catalog.cc:564] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:29.094975 998 raft_consensus.cc:686] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516 [term 1 LEADER]: Becoming Leader. State: Replica: 570e1329f615442d8be94026caf56516, State: Running, Role: LEADER
I20260812 00:00:29.095162 998 consensus_queue.cc:237] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "570e1329f615442d8be94026caf56516" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 34431 } }
I20260812 00:00:29.095690 1000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "570e1329f615442d8be94026caf56516" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "570e1329f615442d8be94026caf56516" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 34431 } } }
I20260812 00:00:29.095811 1000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:29.096200 1005 sys_catalog.cc:455] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 570e1329f615442d8be94026caf56516. Latest consensus state: current_term: 1 leader_uuid: "570e1329f615442d8be94026caf56516" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "570e1329f615442d8be94026caf56516" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 34431 } } }
I20260812 00:00:29.096280 1005 sys_catalog.cc:458] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:29.096652 1013 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:29.097333 1013 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:00:29.099145 1013 catalog_manager.cc:1347] Generated new cluster ID: 8168d1b85e73430ab9d14028f2b7cd47
I20260812 00:00:29.099215 1013 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:00:29.113022 1013 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:00:29.113205 1013 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:29.117691 1013 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516: Generated new TSK 0
I20260812 00:00:29.117890 1013 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:00:29.120770 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:34431
--builtin_ntp_servers=127.25.103.84:40241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 00:00:29.218566 1030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:29.218827 1030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:29.218856 1030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:29.220345 1030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:29.220405 1030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:29.220438 1030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:00:29.222081 1030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:40241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:34431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:29.222401 1030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:29.222741 1030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:29.229460 1041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:29.229547 1030 server_base.cc:1034] running on GCE node
W20260812 00:00:29.229485 1039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:29.229485 1038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:29.230199 1030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:29.230530 1030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:29.231709 1030 hybrid_clock.cc:648] HybridClock initialized: now 1786492829231675 us; error 53 us; skew 500 ppm
I20260812 00:00:29.233518 1030 webserver.cc:460] Webserver started at http://127.25.103.65:39285/ using document root <none> and password file <none>
I20260812 00:00:29.233829 1030 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:29.233891 1030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:29.234084 1030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:29.235695 1030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "8aecfe6d123147d196280e0ab3a4c659"
format_stamp: "Formatted at 2026-08-12 00:00:29 on dist-test-slave-vpvm"
server_key: "48ea6ade4d0bb34937af7bfd076a644e"
server_key_iv: "9215a99fdcdd669572039822316a7f57"
server_key_version: "encryptionkey@0"
I20260812 00:00:29.236155 1030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "8aecfe6d123147d196280e0ab3a4c659"
format_stamp: "Formatted at 2026-08-12 00:00:29 on dist-test-slave-vpvm"
server_key: "48ea6ade4d0bb34937af7bfd076a644e"
server_key_iv: "9215a99fdcdd669572039822316a7f57"
server_key_version: "encryptionkey@0"
I20260812 00:00:29.237900 1030 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 00:00:29.239319 1052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:29.239554 1030 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:29.239717 1030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "8aecfe6d123147d196280e0ab3a4c659"
format_stamp: "Formatted at 2026-08-12 00:00:29 on dist-test-slave-vpvm"
server_key: "48ea6ade4d0bb34937af7bfd076a644e"
server_key_iv: "9215a99fdcdd669572039822316a7f57"
server_key_version: "encryptionkey@0"
I20260812 00:00:29.239835 1030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:29.245891 1030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:29.246263 1030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:29.246411 1030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:29.246652 1030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:29.247051 1030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:29.247097 1030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:29.247133 1030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:29.247155 1030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:29.254774 1030 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:37399
I20260812 00:00:29.254832 1226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:37399 every 8 connection(s)
I20260812 00:00:29.255195 1030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:00:29.258409 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 1030
I20260812 00:00:29.258538 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:00:29.258930 26013 external_mini_cluster.cc:1428] Setting key 62c040f4672199631d8551d72d404e64
I20260812 00:00:29.259966 995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.256193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:39951 (local address 127.25.103.126:34431)
0812 00:00:29.256289 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:29.256292 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:29.256623 (+ 331us) server_negotiation.cc:407] Connection header received
0812 00:00:29.257397 (+ 774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:29.257399 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:29.257408 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:29.257510 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:29.259682 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:29.259683 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:29.259683 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:00:29.259689 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:29.259708 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:00:29.259712 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:29.259760 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:29.259873 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 00:00:29.259890 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 00:00:29.260280 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:34431
--builtin_ntp_servers=127.25.103.84:40241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 00:00:29.260439 1232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.256144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:34431 (local address 127.25.103.65:39951)
0812 00:00:29.256426 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:29.256480 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:29.257202 (+ 722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:29.257693 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:29.257699 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:29.257715 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:29.259470 (+ 1755us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:00:29.259471 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:29.259527 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:00:29.259574 (+ 47us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:29.259770 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:29.259776 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:29.259780 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:00:29.260087 (+ 307us) client_negotiation.cc:240] Negotiation successful
0812 00:00:29.260172 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":102,"threads_started":1}
I20260812 00:00:29.262339 1228 heartbeater.cc:347] Connected to a master server at 127.25.103.126:34431
I20260812 00:00:29.262483 1228 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:29.262676 1228 heartbeater.cc:511] Master 127.25.103.126:34431 requested a full tablet report, sending...
I20260812 00:00:29.263321 932 ts_manager.cc:194] Registered new tserver with Master: 8aecfe6d123147d196280e0ab3a4c659 (127.25.103.65:37399)
W20260812 00:00:29.356865 1233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:29.357122 1233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:29.357152 1233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:29.358784 1233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:29.358850 1233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:29.358886 1233 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:00:29.360509 1233 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:40241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:34431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1233
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:29.360761 1233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:29.361056 1233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:29.366808 1245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:29.366895 1247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:29.366811 1252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:29.367336 1233 server_base.cc:1034] running on GCE node
I20260812 00:00:29.367619 1233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:29.367901 1233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:29.369108 1233 hybrid_clock.cc:648] HybridClock initialized: now 1786492829369057 us; error 71 us; skew 500 ppm
I20260812 00:00:29.370862 1233 webserver.cc:460] Webserver started at http://127.25.103.66:35655/ using document root <none> and password file <none>
I20260812 00:00:29.371172 1233 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:29.371244 1233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:29.371392 1233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:29.372678 1233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "fd3fb9bd090040fd89381ff0e4c5def0"
format_stamp: "Formatted at 2026-08-12 00:00:29 on dist-test-slave-vpvm"
server_key: "74b9cf658ee01f9e5548787668806c4f"
server_key_iv: "6be877994f2387b73daa4341c0484fd4"
server_key_version: "encryptionkey@0"
I20260812 00:00:29.373142 1233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "fd3fb9bd090040fd89381ff0e4c5def0"
format_stamp: "Formatted at 2026-08-12 00:00:29 on dist-test-slave-vpvm"
server_key: "74b9cf658ee01f9e5548787668806c4f"
server_key_iv: "6be877994f2387b73daa4341c0484fd4"
server_key_version: "encryptionkey@0"
I20260812 00:00:29.374804 1233 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260812 00:00:29.375826 1261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:29.376046 1233 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:29.376152 1233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "fd3fb9bd090040fd89381ff0e4c5def0"
format_stamp: "Formatted at 2026-08-12 00:00:29 on dist-test-slave-vpvm"
server_key: "74b9cf658ee01f9e5548787668806c4f"
server_key_iv: "6be877994f2387b73daa4341c0484fd4"
server_key_version: "encryptionkey@0"
I20260812 00:00:29.376227 1233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:29.380611 1233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:29.381059 1233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:29.381246 1233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:29.381495 1233 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:29.381845 1233 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:29.381882 1233 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:29.381913 1233 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:29.381932 1233 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:29.388645 1233 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:33705
I20260812 00:00:29.388691 1421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:33705 every 8 connection(s)
I20260812 00:00:29.389117 1233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:00:29.392984 995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.390069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:56989 (local address 127.25.103.126:34431)
0812 00:00:29.390176 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:29.390180 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:29.390502 (+ 322us) server_negotiation.cc:407] Connection header received
0812 00:00:29.391022 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:29.391024 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:29.391031 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:29.391105 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:29.392720 (+ 1615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:29.392723 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:29.392723 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:00:29.392729 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:29.392750 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:00:29.392755 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:29.392825 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:29.392896 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 00:00:29.392912 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 00:00:29.393175 1424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.389988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:34431 (local address 127.25.103.66:56989)
0812 00:00:29.390270 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:29.390324 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:29.390895 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:29.391183 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:29.391187 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:29.391199 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:29.392500 (+ 1301us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:00:29.392501 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:29.392542 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:00:29.392582 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:29.392827 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:29.392830 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:29.392833 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:00:29.392891 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 00:00:29.392957 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":96,"threads_started":1}
I20260812 00:00:29.393860 1422 heartbeater.cc:347] Connected to a master server at 127.25.103.126:34431
I20260812 00:00:29.394028 1422 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:29.394207 1422 heartbeater.cc:511] Master 127.25.103.126:34431 requested a full tablet report, sending...
I20260812 00:00:29.394760 932 ts_manager.cc:194] Registered new tserver with Master: fd3fb9bd090040fd89381ff0e4c5def0 (127.25.103.66:33705)
I20260812 00:00:29.397238 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 1233
I20260812 00:00:29.397331 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:00:29.397483 26013 external_mini_cluster.cc:1428] Setting key 5e93e54fa4ca35b47f62525c42aa4665
I20260812 00:00:29.398924 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:34431
--builtin_ntp_servers=127.25.103.84:40241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 00:00:29.488291 1425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:29.488550 1425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:29.488577 1425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:29.489889 1425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:29.489944 1425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:29.490033 1425 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:00:29.491598 1425 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:40241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:34431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1425
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:29.491894 1425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:29.492230 1425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:29.497974 1434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:29.497967 1435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:29.497970 1438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:29.498229 1425 server_base.cc:1034] running on GCE node
I20260812 00:00:29.498447 1425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:29.498713 1425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:29.499905 1425 hybrid_clock.cc:648] HybridClock initialized: now 1786492829499872 us; error 45 us; skew 500 ppm
I20260812 00:00:29.501391 1425 webserver.cc:460] Webserver started at http://127.25.103.67:39891/ using document root <none> and password file <none>
I20260812 00:00:29.501648 1425 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:29.501701 1425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:29.501837 1425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:29.503019 1425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "2e213f9437a9487b9a653fa1b330ab1c"
format_stamp: "Formatted at 2026-08-12 00:00:29 on dist-test-slave-vpvm"
server_key: "390c0c79296ec3997eed8839b6ca982d"
server_key_iv: "dd4cead8203fc9b5bca92be73f3e16ac"
server_key_version: "encryptionkey@0"
I20260812 00:00:29.503410 1425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "2e213f9437a9487b9a653fa1b330ab1c"
format_stamp: "Formatted at 2026-08-12 00:00:29 on dist-test-slave-vpvm"
server_key: "390c0c79296ec3997eed8839b6ca982d"
server_key_iv: "dd4cead8203fc9b5bca92be73f3e16ac"
server_key_version: "encryptionkey@0"
I20260812 00:00:29.505023 1425 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:00:29.506134 1445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:29.506345 1425 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:29.506455 1425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "2e213f9437a9487b9a653fa1b330ab1c"
format_stamp: "Formatted at 2026-08-12 00:00:29 on dist-test-slave-vpvm"
server_key: "390c0c79296ec3997eed8839b6ca982d"
server_key_iv: "dd4cead8203fc9b5bca92be73f3e16ac"
server_key_version: "encryptionkey@0"
I20260812 00:00:29.506538 1425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:29.510696 1425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:29.511109 1425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:29.511270 1425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:29.511525 1425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:29.511969 1425 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:29.512008 1425 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:29.512044 1425 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:29.512070 1425 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:29.519662 1425 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:40787
I20260812 00:00:29.519754 1620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:40787 every 8 connection(s)
I20260812 00:00:29.520149 1425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:00:29.523873 995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.521138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:55389 (local address 127.25.103.126:34431)
0812 00:00:29.521265 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:29.521268 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:29.521521 (+ 253us) server_negotiation.cc:407] Connection header received
0812 00:00:29.522066 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:29.522067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:29.522076 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:29.522163 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:29.523534 (+ 1371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:29.523535 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:29.523536 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:00:29.523540 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:29.523560 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:00:29.523573 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:29.523649 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:29.523788 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 00:00:29.523810 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 00:00:29.523989 1623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.521086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:34431 (local address 127.25.103.67:55389)
0812 00:00:29.521352 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:29.521404 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:29.521894 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:29.522242 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:29.522246 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:29.522256 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:29.523321 (+ 1065us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:00:29.523321 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:29.523355 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:00:29.523403 (+ 48us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:29.523661 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:29.523664 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:29.523667 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:00:29.523734 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 00:00:29.523794 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":149,"threads_started":1}
I20260812 00:00:29.524564 1621 heartbeater.cc:347] Connected to a master server at 127.25.103.126:34431
I20260812 00:00:29.524706 1621 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:29.524899 1621 heartbeater.cc:511] Master 127.25.103.126:34431 requested a full tablet report, sending...
I20260812 00:00:29.525558 932 ts_manager.cc:194] Registered new tserver with Master: 2e213f9437a9487b9a653fa1b330ab1c (127.25.103.67:40787)
I20260812 00:00:29.526209 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 1425
I20260812 00:00:29.526304 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:00:29.526481 26013 external_mini_cluster.cc:1428] Setting key 132626530344e9b354c7a2139ce0b207
I20260812 00:00:29.527580 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:00:29.530278 995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.529016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53140 (local address 127.25.103.126:34431)
0812 00:00:29.529079 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:29.529081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:29.529190 (+ 109us) server_negotiation.cc:407] Connection header received
0812 00:00:29.529322 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:29.529323 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:29.529330 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:29.529391 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:29.530069 (+ 678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:29.530070 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:29.530070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:00:29.530074 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:29.530090 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:00:29.530095 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:29.530143 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:29.530192 (+ 49us) server_negotiation.cc:299] Negotiation successful
0812 00:00:29.530204 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:00:29.532727 932 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53140:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:00:29.535316 932 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:00:29.539921 1633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.538139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:40787 (local address 127.0.0.1:47372)
0812 00:00:29.538345 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:29.538388 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:29.538450 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:29.539030 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:29.539032 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:29.539034 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:29.539516 (+ 482us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:00:29.539516 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:29.539524 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:00:29.539538 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:29.539729 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:29.539738 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:29.539741 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:00:29.539808 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 00:00:29.539818 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":65,"threads_started":1}
I20260812 00:00:29.539933 1632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.538349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:33705 (local address 127.0.0.1:36772)
0812 00:00:29.538526 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:29.538534 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:29.538565 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:29.538978 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:29.538979 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:29.538982 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:29.539403 (+ 421us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:00:29.539403 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:29.539421 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:00:29.539448 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:29.539772 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:29.539772 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:29.539773 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 00:00:29.539801 (+ 28us) client_negotiation.cc:240] Negotiation successful
0812 00:00:29.539815 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":69,"threads_started":1}
I20260812 00:00:29.539980 1638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.538564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36772 (local address 127.25.103.66:33705)
0812 00:00:29.538820 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:29.538824 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:29.538833 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:29.538857 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:29.538859 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:29.538867 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:29.539139 (+ 272us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:29.539640 (+ 501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:29.539644 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:29.539644 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:00:29.539647 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:29.539681 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:00:29.539696 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:29.539860 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:29.539881 (+ 21us) server_negotiation.cc:299] Negotiation successful
0812 00:00:29.539905 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":170,"threads_started":1}
I20260812 00:00:29.540160 1634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.538263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47372 (local address 127.25.103.67:40787)
0812 00:00:29.538866 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:29.538871 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:29.538880 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:29.538905 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:29.538907 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:29.538916 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:29.539179 (+ 263us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:29.539619 (+ 440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:29.539624 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:29.539624 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:00:29.539628 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:29.539656 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:00:29.539675 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:29.539731 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:29.540057 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 00:00:29.540074 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":94,"threads_started":1}
I20260812 00:00:29.540179 1637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.538333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37672 (local address 127.25.103.65:37399)
0812 00:00:29.538541 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:29.538548 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:29.538559 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:00:29.538694 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:29.538697 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:29.538705 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:29.538772 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:29.539792 (+ 1020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:29.539798 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:29.539798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:00:29.539802 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:29.539832 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:00:29.539851 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:29.539901 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:29.540076 (+ 175us) server_negotiation.cc:299] Negotiation successful
0812 00:00:29.540096 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":107,"threads_started":1}
I20260812 00:00:29.540581 1636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.538143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:37399 (local address 127.0.0.1:37672)
0812 00:00:29.538469 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:29.538480 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:29.538549 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:29.538780 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:29.538787 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:29.538795 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:29.539713 (+ 918us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:00:29.539713 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:29.539720 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:00:29.539730 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:29.539924 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:29.539925 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:29.539925 (+ 0us) client_negotiation.cc:769] Sending connection context
0812 00:00:29.539967 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 00:00:29.539981 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":119,"threads_started":1}
I20260812 00:00:29.540907 1328 tablet_service.cc:1467] Processing CreateTablet for tablet 3b63df2ac1ab4be484f5adc8fcba5f87 (DEFAULT_TABLE table=test-table [id=26ab645b830a4e37b94b015991150ca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:29.540874 1517 tablet_service.cc:1467] Processing CreateTablet for tablet 3b63df2ac1ab4be484f5adc8fcba5f87 (DEFAULT_TABLE table=test-table [id=26ab645b830a4e37b94b015991150ca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:29.541191 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 3b63df2ac1ab4be484f5adc8fcba5f87 (DEFAULT_TABLE table=test-table [id=26ab645b830a4e37b94b015991150ca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:29.541301 1517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b63df2ac1ab4be484f5adc8fcba5f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:29.541301 1328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b63df2ac1ab4be484f5adc8fcba5f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:29.541501 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b63df2ac1ab4be484f5adc8fcba5f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:29.544245 1639 tablet_bootstrap.cc:492] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c: Bootstrap starting.
I20260812 00:00:29.544669 1640 tablet_bootstrap.cc:492] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0: Bootstrap starting.
I20260812 00:00:29.544986 1641 tablet_bootstrap.cc:492] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659: Bootstrap starting.
I20260812 00:00:29.545035 1639 tablet_bootstrap.cc:654] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:29.545288 1640 tablet_bootstrap.cc:654] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:29.545337 1639 log.cc:824] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:29.545584 1641 tablet_bootstrap.cc:654] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:29.545766 1640 log.cc:824] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:29.545887 1641 log.cc:824] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:29.546384 1639 tablet_bootstrap.cc:492] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c: No bootstrap required, opened a new log
I20260812 00:00:29.546470 1639 ts_tablet_manager.cc:1397] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:00:29.546518 1640 tablet_bootstrap.cc:492] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0: No bootstrap required, opened a new log
I20260812 00:00:29.546551 1641 tablet_bootstrap.cc:492] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659: No bootstrap required, opened a new log
I20260812 00:00:29.546590 1640 ts_tablet_manager.cc:1397] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:29.546598 1641 ts_tablet_manager.cc:1397] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:29.548358 1639 raft_consensus.cc:348] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e213f9437a9487b9a653fa1b330ab1c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 40787 } } peers { permanent_uuid: "8aecfe6d123147d196280e0ab3a4c659" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37399 } } peers { permanent_uuid: "fd3fb9bd090040fd89381ff0e4c5def0" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33705 } }
I20260812 00:00:29.548523 1639 raft_consensus.cc:374] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:29.548557 1639 raft_consensus.cc:729] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e213f9437a9487b9a653fa1b330ab1c, State: Initialized, Role: FOLLOWER
I20260812 00:00:29.548681 1639 consensus_queue.cc:260] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e213f9437a9487b9a653fa1b330ab1c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 40787 } } peers { permanent_uuid: "8aecfe6d123147d196280e0ab3a4c659" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37399 } } peers { permanent_uuid: "fd3fb9bd090040fd89381ff0e4c5def0" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33705 } }
I20260812 00:00:29.548969 1639 ts_tablet_manager.cc:1428] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:00:29.549131 1640 raft_consensus.cc:348] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e213f9437a9487b9a653fa1b330ab1c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 40787 } } peers { permanent_uuid: "8aecfe6d123147d196280e0ab3a4c659" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37399 } } peers { permanent_uuid: "fd3fb9bd090040fd89381ff0e4c5def0" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33705 } }
I20260812 00:00:29.549131 1641 raft_consensus.cc:348] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e213f9437a9487b9a653fa1b330ab1c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 40787 } } peers { permanent_uuid: "8aecfe6d123147d196280e0ab3a4c659" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37399 } } peers { permanent_uuid: "fd3fb9bd090040fd89381ff0e4c5def0" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33705 } }
I20260812 00:00:29.549304 1640 raft_consensus.cc:374] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:29.549304 1641 raft_consensus.cc:374] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:29.549337 1640 raft_consensus.cc:729] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3fb9bd090040fd89381ff0e4c5def0, State: Initialized, Role: FOLLOWER
I20260812 00:00:29.549337 1641 raft_consensus.cc:729] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aecfe6d123147d196280e0ab3a4c659, State: Initialized, Role: FOLLOWER
I20260812 00:00:29.549448 1640 consensus_queue.cc:260] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e213f9437a9487b9a653fa1b330ab1c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 40787 } } peers { permanent_uuid: "8aecfe6d123147d196280e0ab3a4c659" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37399 } } peers { permanent_uuid: "fd3fb9bd090040fd89381ff0e4c5def0" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33705 } }
I20260812 00:00:29.549508 1621 heartbeater.cc:503] Master 127.25.103.126:34431 was elected leader, sending a full tablet report...
I20260812 00:00:29.549721 1640 ts_tablet_manager.cc:1428] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:00:29.549842 1422 heartbeater.cc:503] Master 127.25.103.126:34431 was elected leader, sending a full tablet report...
I20260812 00:00:29.549896 1641 consensus_queue.cc:260] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e213f9437a9487b9a653fa1b330ab1c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 40787 } } peers { permanent_uuid: "8aecfe6d123147d196280e0ab3a4c659" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37399 } } peers { permanent_uuid: "fd3fb9bd090040fd89381ff0e4c5def0" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33705 } }
I20260812 00:00:29.550206 1641 ts_tablet_manager.cc:1428] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260812 00:00:29.550631 1228 heartbeater.cc:503] Master 127.25.103.126:34431 was elected leader, sending a full tablet report...
W20260812 00:00:29.639828 1423 tablet.cc:2369] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:00:29.708225 1649 raft_consensus.cc:482] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:00:29.708465 1649 raft_consensus.cc:504] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e213f9437a9487b9a653fa1b330ab1c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 40787 } } peers { permanent_uuid: "8aecfe6d123147d196280e0ab3a4c659" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37399 } } peers { permanent_uuid: "fd3fb9bd090040fd89381ff0e4c5def0" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33705 } }
I20260812 00:00:29.708990 1649 leader_election.cc:288] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e213f9437a9487b9a653fa1b330ab1c (127.25.103.67:40787), fd3fb9bd090040fd89381ff0e4c5def0 (127.25.103.66:33705)
I20260812 00:00:29.710762 1634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.709394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:33191 (local address 127.25.103.67:40787)
0812 00:00:29.709469 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:29.709472 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:29.709489 (+ 17us) server_negotiation.cc:407] Connection header received
0812 00:00:29.709574 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:29.709575 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:29.709582 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:29.709669 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:29.710459 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:29.710461 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:29.710461 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:00:29.710467 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:29.710509 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:00:29.710514 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:29.710579 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:29.710663 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 00:00:29.710678 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:00:29.710760 1232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.709262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:40787 (local address 127.25.103.65:33191)
0812 00:00:29.709367 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:29.709385 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:29.709487 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:29.709706 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:29.709707 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:29.709711 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:29.710331 (+ 620us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:00:29.710332 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:29.710345 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:00:29.710365 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:29.710584 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:29.710585 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:29.710586 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 00:00:29.710651 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 00:00:29.710670 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260812 00:00:29.710834 1638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.709608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:52893 (local address 127.25.103.66:33705)
0812 00:00:29.709751 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:29.709754 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:29.709763 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:29.709839 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:29.709840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:29.709848 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:29.709990 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:29.710593 (+ 603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:29.710595 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:29.710595 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:00:29.710600 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:29.710621 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:00:29.710627 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:29.710686 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:29.710750 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 00:00:29.710764 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260812 00:00:29.710886 1651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.709401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:33705 (local address 127.25.103.65:52893)
0812 00:00:29.709605 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:29.709614 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:29.709664 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:29.710007 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:29.710008 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:29.710012 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:29.710461 (+ 449us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:00:29.710462 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:29.710473 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:00:29.710494 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:29.710688 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:29.710690 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:29.710690 (+ 0us) client_negotiation.cc:769] Sending connection context
0812 00:00:29.710743 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 00:00:29.710760 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":132,"threads_started":1}
I20260812 00:00:29.711217 1551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b63df2ac1ab4be484f5adc8fcba5f87" candidate_uuid: "8aecfe6d123147d196280e0ab3a4c659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e213f9437a9487b9a653fa1b330ab1c" is_pre_election: true
I20260812 00:00:29.711272 1355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b63df2ac1ab4be484f5adc8fcba5f87" candidate_uuid: "8aecfe6d123147d196280e0ab3a4c659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3fb9bd090040fd89381ff0e4c5def0" is_pre_election: true
I20260812 00:00:29.711400 1551 raft_consensus.cc:2454] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aecfe6d123147d196280e0ab3a4c659 in term 0.
I20260812 00:00:29.711465 1355 raft_consensus.cc:2454] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aecfe6d123147d196280e0ab3a4c659 in term 0.
I20260812 00:00:29.711709 1054 leader_election.cc:302] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e213f9437a9487b9a653fa1b330ab1c, 8aecfe6d123147d196280e0ab3a4c659; no voters:
I20260812 00:00:29.711899 1649 raft_consensus.cc:2781] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:00:29.712001 1649 raft_consensus.cc:482] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:00:29.712031 1649 raft_consensus.cc:3037] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:29.713152 1649 raft_consensus.cc:504] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e213f9437a9487b9a653fa1b330ab1c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 40787 } } peers { permanent_uuid: "8aecfe6d123147d196280e0ab3a4c659" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37399 } } peers { permanent_uuid: "fd3fb9bd090040fd89381ff0e4c5def0" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33705 } }
I20260812 00:00:29.713349 1649 leader_election.cc:288] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [CANDIDATE]: Term 1 election: Requested vote from peers 2e213f9437a9487b9a653fa1b330ab1c (127.25.103.67:40787), fd3fb9bd090040fd89381ff0e4c5def0 (127.25.103.66:33705)
I20260812 00:00:29.713697 1551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b63df2ac1ab4be484f5adc8fcba5f87" candidate_uuid: "8aecfe6d123147d196280e0ab3a4c659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e213f9437a9487b9a653fa1b330ab1c"
I20260812 00:00:29.713827 1551 raft_consensus.cc:3037] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:29.713901 1355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b63df2ac1ab4be484f5adc8fcba5f87" candidate_uuid: "8aecfe6d123147d196280e0ab3a4c659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3fb9bd090040fd89381ff0e4c5def0"
I20260812 00:00:29.714102 1355 raft_consensus.cc:3037] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:29.714923 1551 raft_consensus.cc:2454] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aecfe6d123147d196280e0ab3a4c659 in term 1.
I20260812 00:00:29.715022 1355 raft_consensus.cc:2454] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aecfe6d123147d196280e0ab3a4c659 in term 1.
I20260812 00:00:29.715201 1054 leader_election.cc:302] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e213f9437a9487b9a653fa1b330ab1c, 8aecfe6d123147d196280e0ab3a4c659; no voters:
I20260812 00:00:29.715353 1649 raft_consensus.cc:2781] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:29.715577 1649 raft_consensus.cc:686] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [term 1 LEADER]: Becoming Leader. State: Replica: 8aecfe6d123147d196280e0ab3a4c659, State: Running, Role: LEADER
I20260812 00:00:29.715698 1649 consensus_queue.cc:237] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e213f9437a9487b9a653fa1b330ab1c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 40787 } } peers { permanent_uuid: "8aecfe6d123147d196280e0ab3a4c659" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37399 } } peers { permanent_uuid: "fd3fb9bd090040fd89381ff0e4c5def0" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33705 } }
I20260812 00:00:29.716945 932 catalog_manager.cc:5495] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8aecfe6d123147d196280e0ab3a4c659 (127.25.103.65). New cstate: current_term: 1 leader_uuid: "8aecfe6d123147d196280e0ab3a4c659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e213f9437a9487b9a653fa1b330ab1c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 40787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aecfe6d123147d196280e0ab3a4c659" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3fb9bd090040fd89381ff0e4c5def0" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260812 00:00:29.725304 1637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.724289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37682 (local address 127.25.103.65:37399)
0812 00:00:29.724377 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:29.724378 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:29.724387 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:29.724428 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:29.724429 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:29.724444 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:29.724494 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:29.725074 (+ 580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:29.725075 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:29.725076 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:00:29.725080 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:29.725097 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:00:29.725102 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:29.725151 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:29.725204 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 00:00:29.725218 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 00:00:29.728082 1551 raft_consensus.cc:1261] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c [term 1 FOLLOWER]: Refusing update from remote peer 8aecfe6d123147d196280e0ab3a4c659: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:29.728082 1355 raft_consensus.cc:1261] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0 [term 1 FOLLOWER]: Refusing update from remote peer 8aecfe6d123147d196280e0ab3a4c659: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:29.728576 1649 consensus_queue.cc:1035] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3fb9bd090040fd89381ff0e4c5def0" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:29.728751 1652 consensus_queue.cc:1035] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e213f9437a9487b9a653fa1b330ab1c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 40787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:29.731798 1661 mvcc.cc:205] Tried to move back new op lower bound from 7317474630561390592 to 7317474630516248576. Current Snapshot: MvccSnapshot[applied={T|T < 7317474630561390592}]
I20260812 00:00:29.732697 1662 mvcc.cc:205] Tried to move back new op lower bound from 7317474630561390592 to 7317474630516248576. Current Snapshot: MvccSnapshot[applied={T|T < 7317474630561390592 or (T in {7317474630561390592})}]
I20260812 00:00:29.732841 1663 mvcc.cc:205] Tried to move back new op lower bound from 7317474630561390592 to 7317474630516248576. Current Snapshot: MvccSnapshot[applied={T|T < 7317474630561390592 or (T in {7317474630561390592})}]
I20260812 00:00:29.734750 930 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:29.734849 930 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:29.735682 930 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 570e1329f615442d8be94026caf56516: Sending DeleteTablet for 3 replicas of tablet 3b63df2ac1ab4be484f5adc8fcba5f87
I20260812 00:00:29.735999 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b63df2ac1ab4be484f5adc8fcba5f87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:29 UTC) from {username='slave'} at 127.0.0.1:37672
I20260812 00:00:29.736038 1328 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b63df2ac1ab4be484f5adc8fcba5f87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:29 UTC) from {username='slave'} at 127.0.0.1:36772
I20260812 00:00:29.736300 1673 tablet_replica.cc:330] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659: stopping tablet replica
I20260812 00:00:29.736299 1517 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b63df2ac1ab4be484f5adc8fcba5f87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:29 UTC) from {username='slave'} at 127.0.0.1:47372
I20260812 00:00:29.736410 1673 raft_consensus.cc:2229] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:00:29.736552 1673 raft_consensus.cc:2258] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:29.736567 1677 tablet_replica.cc:330] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c: stopping tablet replica
I20260812 00:00:29.736774 1677 raft_consensus.cc:2229] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:29.736903 1677 raft_consensus.cc:2258] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:29.737047 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 1030
I20260812 00:00:29.737047 1673 ts_tablet_manager.cc:1905] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 8aecfe6d123147d196280e0ab3a4c659: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:29.743966 1677 ts_tablet_manager.cc:1905] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:29.746333 1677 ts_tablet_manager.cc:1918] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:00:29.746459 1677 log.cc:1196] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/3b63df2ac1ab4be484f5adc8fcba5f87
I20260812 00:00:29.746778 1677 ts_tablet_manager.cc:1939] T 3b63df2ac1ab4be484f5adc8fcba5f87 P 2e213f9437a9487b9a653fa1b330ab1c: Deleting consensus metadata
I20260812 00:00:29.748278 1674 tablet_replica.cc:330] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0: stopping tablet replica
I20260812 00:00:29.748303 912 catalog_manager.cc:4841] TS 2e213f9437a9487b9a653fa1b330ab1c (127.25.103.67:40787): tablet 3b63df2ac1ab4be484f5adc8fcba5f87 (table test-table [id=26ab645b830a4e37b94b015991150ca8]) successfully deleted
I20260812 00:00:29.748438 1674 raft_consensus.cc:2229] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:29.748543 1674 raft_consensus.cc:2258] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:29.750772 1674 ts_tablet_manager.cc:1905] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:29.752501 1674 ts_tablet_manager.cc:1918] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:00:29.752594 1674 log.cc:1196] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/3b63df2ac1ab4be484f5adc8fcba5f87
I20260812 00:00:29.752838 1674 ts_tablet_manager.cc:1939] T 3b63df2ac1ab4be484f5adc8fcba5f87 P fd3fb9bd090040fd89381ff0e4c5def0: Deleting consensus metadata
I20260812 00:00:29.753571 912 catalog_manager.cc:4841] TS fd3fb9bd090040fd89381ff0e4c5def0 (127.25.103.66:33705): tablet 3b63df2ac1ab4be484f5adc8fcba5f87 (table test-table [id=26ab645b830a4e37b94b015991150ca8]) successfully deleted
W20260812 00:00:29.754487 917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.103.65:37399 (error 108)
I20260812 00:00:29.755164 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 1233
I20260812 00:00:29.755226 1636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.755026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:37399 (local address 127.0.0.1:37692)
0812 00:00:29.755121 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:29.755190 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:37399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260812 00:00:29.755353 917 catalog_manager.cc:4584] TS 8aecfe6d123147d196280e0ab3a4c659 (127.25.103.65:37399): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3b63df2ac1ab4be484f5adc8fcba5f87: Network error: Client connection negotiation failed: client connection to 127.25.103.65:37399: connect: Connection refused (error 111)
I20260812 00:00:29.799038 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 1425
I20260812 00:00:29.808899 1636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.808762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:37399 (local address 127.0.0.1:37708)
0812 00:00:29.808820 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:29.808852 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:37399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 00:00:29.809298 1636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.809241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:37399 (local address 127.0.0.1:37716)
0812 00:00:29.809265 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:29.809282 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:37399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260812 00:00:29.816357 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 889
2026-08-12T00:00:29Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (898 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 00:00:29.848547 26013 mini_oidc.cc:152] Starting JWKS server
I20260812 00:00:29.849835 26013 webserver.cc:460] Webserver started at https://127.0.0.1:42321/ using document root <none> and password file <none>
I20260812 00:00:29.849941 26013 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 00:00:29.850143 26013 webserver.cc:460] Webserver started at http://127.0.0.1:43633/ using document root <none> and password file <none>
2026-08-12T00:00:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:29Z Disabled control of system clock
I20260812 00:00:29.861570 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:34945
--webserver_interface=127.25.103.126
--webserver_port=0
--builtin_ntp_servers=127.25.103.84:34881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:34945
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42321/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/testchainca.cert with env {}
W20260812 00:00:29.951212 1689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:29.951457 1689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:29.951483 1689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:29.952777 1689 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:29.952826 1689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:29.952836 1689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:29.952848 1689 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:29.952859 1689 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:00:29.952870 1689 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:00:29.952880 1689 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42321/jwks.json
I20260812 00:00:29.954703 1689 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:34881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:34945
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:34945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42321/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:29.954954 1689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:29.955152 1689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:00:29.961536 1689 server_base.cc:1034] running on GCE node
W20260812 00:00:29.961457 1706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:29.961514 1708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:29.961514 1704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:29.962182 1689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:29.962836 1689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:29.964058 1689 hybrid_clock.cc:648] HybridClock initialized: now 1786492829964022 us; error 52 us; skew 500 ppm
I20260812 00:00:29.965828 1689 webserver.cc:460] Webserver started at http://127.25.103.126:44343/ using document root <none> and password file <none>
I20260812 00:00:29.966161 1689 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:29.966228 1689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:29.966418 1689 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:29.967804 1689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "dadf165d047e4a2da825d5bdfb7a5a69"
format_stamp: "Formatted at 2026-08-12 00:00:29 on dist-test-slave-vpvm"
server_key: "59f99b252c85c190f60d93f6e8768cdf"
server_key_iv: "f0c26030b80047b1e2f41a6d4c44377b"
server_key_version: "encryptionkey@0"
I20260812 00:00:29.968206 1689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "dadf165d047e4a2da825d5bdfb7a5a69"
format_stamp: "Formatted at 2026-08-12 00:00:29 on dist-test-slave-vpvm"
server_key: "59f99b252c85c190f60d93f6e8768cdf"
server_key_iv: "f0c26030b80047b1e2f41a6d4c44377b"
server_key_version: "encryptionkey@0"
I20260812 00:00:29.969874 1689 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260812 00:00:29.971416 1718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:29.971761 1689 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:29.971903 1689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "dadf165d047e4a2da825d5bdfb7a5a69"
format_stamp: "Formatted at 2026-08-12 00:00:29 on dist-test-slave-vpvm"
server_key: "59f99b252c85c190f60d93f6e8768cdf"
server_key_iv: "f0c26030b80047b1e2f41a6d4c44377b"
server_key_version: "encryptionkey@0"
I20260812 00:00:29.971997 1689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:29.985661 1689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:29.986315 1689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:29.986497 1689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:29.991374 1689 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:34945
I20260812 00:00:29.991423 1794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:34945 every 8 connection(s)
I20260812 00:00:29.991797 1689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:29.993237 1797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:29.996367 1797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69: Bootstrap starting.
I20260812 00:00:29.997116 1797 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:29.997617 1797 log.cc:824] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:29.997783 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 1689
I20260812 00:00:29.997893 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:00:29.998123 26013 external_mini_cluster.cc:1428] Setting key 73d3b10f06afebbadc27b9dcc25ca6f5
I20260812 00:00:29.998839 1797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69: No bootstrap required, opened a new log
I20260812 00:00:30.001430 1797 raft_consensus.cc:348] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dadf165d047e4a2da825d5bdfb7a5a69" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 34945 } }
I20260812 00:00:30.001690 1797 raft_consensus.cc:374] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:30.001727 1797 raft_consensus.cc:729] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dadf165d047e4a2da825d5bdfb7a5a69, State: Initialized, Role: FOLLOWER
I20260812 00:00:30.001897 1797 consensus_queue.cc:260] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dadf165d047e4a2da825d5bdfb7a5a69" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 34945 } }
I20260812 00:00:30.002208 1797 raft_consensus.cc:388] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:30.002295 1797 raft_consensus.cc:482] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:30.002405 1797 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:30.003443 1797 raft_consensus.cc:504] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dadf165d047e4a2da825d5bdfb7a5a69" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 34945 } }
I20260812 00:00:30.003574 1797 leader_election.cc:302] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dadf165d047e4a2da825d5bdfb7a5a69; no voters:
I20260812 00:00:30.003834 1797 leader_election.cc:288] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:00:30.003950 1805 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:30.004190 1797 sys_catalog.cc:564] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:30.004197 1805 raft_consensus.cc:686] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69 [term 1 LEADER]: Becoming Leader. State: Replica: dadf165d047e4a2da825d5bdfb7a5a69, State: Running, Role: LEADER
I20260812 00:00:30.004470 1805 consensus_queue.cc:237] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dadf165d047e4a2da825d5bdfb7a5a69" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 34945 } }
I20260812 00:00:30.004927 1807 sys_catalog.cc:455] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dadf165d047e4a2da825d5bdfb7a5a69. Latest consensus state: current_term: 1 leader_uuid: "dadf165d047e4a2da825d5bdfb7a5a69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dadf165d047e4a2da825d5bdfb7a5a69" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 34945 } } }
I20260812 00:00:30.005038 1807 sys_catalog.cc:458] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:30.004938 1806 sys_catalog.cc:455] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dadf165d047e4a2da825d5bdfb7a5a69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dadf165d047e4a2da825d5bdfb7a5a69" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 34945 } } }
I20260812 00:00:30.005288 1806 sys_catalog.cc:458] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:30.005295 1816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:30.005985 1816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:00:30.008055 1802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:29.998827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50860 (local address 127.25.103.126:34945)
0812 00:00:29.999097 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:29.999109 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:29.999150 (+ 41us) server_negotiation.cc:407] Connection header received
0812 00:00:30.000441 (+ 1291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:30.000454 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:30.000558 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:30.000752 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:30.001028 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.003030 (+ 2002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.004272 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.005172 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.005330 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:30.006611 (+ 1281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:30.006616 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:30.006617 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:00:30.007110 (+ 493us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:30.007197 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:00:30.007223 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:30.007364 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:30.007630 (+ 266us) server_negotiation.cc:299] Negotiation successful
0812 00:00:30.007763 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":106,"threads_started":1}
I20260812 00:00:30.009035 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:00:30.009562 1816 catalog_manager.cc:1347] Generated new cluster ID: 97c0cd6a72ad48bfb984c2f5a7a5f934
I20260812 00:00:30.009682 1816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:00:30.039291 1816 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:00:30.039877 1816 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:30.045224 1816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dadf165d047e4a2da825d5bdfb7a5a69: Generated new TSK 0
I20260812 00:00:30.045464 1816 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 00:00:30.080050 1847 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 00:00:30.080209 1847 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 00:00:30.080439 1802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:30.062739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50870 (local address 127.25.103.126:34945)
0812 00:00:30.062788 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:30.062790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:30.062974 (+ 184us) server_negotiation.cc:407] Connection header received
0812 00:00:30.063148 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:30.063149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:30.063167 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:30.063234 (+ 67us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:00:30.063462 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.064172 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.065257 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.065591 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.065672 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:30.065926 (+ 254us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:00:30.080164 (+ 14238us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42321/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 00:00:30.080366 (+ 202us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50870: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42321/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 00:00:30.080506 1802 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50870: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42321/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260812 00:00:30.081073 1845 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:30.062636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:34945 (local address 127.0.0.1:50870)
0812 00:00:30.062836 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:30.062850 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:30.062937 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:30.063259 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:30.063260 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:30.063262 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:00:30.063353 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:30.063356 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.064297 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.064298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:30.065162 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:30.065164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.065702 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.065704 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:30.065762 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:30.065795 (+ 33us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:00:30.080461 (+ 14666us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42321/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 00:00:30.080700 (+ 239us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.103.126:34945: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42321/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":90,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.25.103.126:34945: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42321/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 00:00:30.081875 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 1689
2026-08-12T00:00:30Z chronyd exiting
I20260812 00:00:30.139231 26013 test_util.cc:175] -----------------------------------------------
I20260812 00:00:30.139418 26013 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492802321514-26013-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (292 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 00:00:30.140549 26013 mini_oidc.cc:152] Starting JWKS server
I20260812 00:00:30.141402 26013 webserver.cc:460] Webserver started at https://127.0.0.1:33149/ using document root <none> and password file <none>
I20260812 00:00:30.141455 26013 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 00:00:30.141601 26013 webserver.cc:460] Webserver started at http://127.0.0.1:36155/ using document root <none> and password file <none>
2026-08-12T00:00:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:30Z Disabled control of system clock
I20260812 00:00:30.153266 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:45609
--webserver_interface=127.25.103.126
--webserver_port=0
--builtin_ntp_servers=127.25.103.84:39441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:45609
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33149/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/testchainca.cert with env {}
W20260812 00:00:30.241426 1858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:30.241676 1858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:30.241699 1858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:30.242967 1858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:30.243021 1858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:30.243033 1858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:30.243045 1858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:30.243057 1858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:00:30.243068 1858 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:00:30.243078 1858 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33149/jwks.json
I20260812 00:00:30.244763 1858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:39441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:45609
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:45609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33149/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:30.245007 1858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:30.245195 1858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:30.250416 1864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:30.250416 1869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:30.250666 1858 server_base.cc:1034] running on GCE node
W20260812 00:00:30.250591 1863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:30.251194 1858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:30.251559 1858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:30.252722 1858 hybrid_clock.cc:648] HybridClock initialized: now 1786492830252705 us; error 37 us; skew 500 ppm
I20260812 00:00:30.254421 1858 webserver.cc:460] Webserver started at http://127.25.103.126:40093/ using document root <none> and password file <none>
I20260812 00:00:30.254726 1858 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:30.254807 1858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:30.254957 1858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:30.256521 1858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "81eb0339d45549a196658775fe094bae"
format_stamp: "Formatted at 2026-08-12 00:00:30 on dist-test-slave-vpvm"
server_key: "62460bccd6116448e8d87c8e61508fa8"
server_key_iv: "24502a320a2b90b2eb620f68f62b504d"
server_key_version: "encryptionkey@0"
I20260812 00:00:30.257050 1858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "81eb0339d45549a196658775fe094bae"
format_stamp: "Formatted at 2026-08-12 00:00:30 on dist-test-slave-vpvm"
server_key: "62460bccd6116448e8d87c8e61508fa8"
server_key_iv: "24502a320a2b90b2eb620f68f62b504d"
server_key_version: "encryptionkey@0"
I20260812 00:00:30.259136 1858 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260812 00:00:30.260056 1880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:30.260301 1858 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:00:30.260430 1858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "81eb0339d45549a196658775fe094bae"
format_stamp: "Formatted at 2026-08-12 00:00:30 on dist-test-slave-vpvm"
server_key: "62460bccd6116448e8d87c8e61508fa8"
server_key_iv: "24502a320a2b90b2eb620f68f62b504d"
server_key_version: "encryptionkey@0"
I20260812 00:00:30.260560 1858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:30.275962 1858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:30.276301 1858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:30.276412 1858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:30.280679 1858 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:45609
I20260812 00:00:30.280716 1958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:45609 every 8 connection(s)
I20260812 00:00:30.281075 1858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:30.281790 1960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:30.284780 1960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae: Bootstrap starting.
I20260812 00:00:30.285434 1960 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:30.285701 1960 log.cc:824] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:30.286593 1960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae: No bootstrap required, opened a new log
I20260812 00:00:30.288298 1960 raft_consensus.cc:348] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81eb0339d45549a196658775fe094bae" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45609 } }
I20260812 00:00:30.288482 1960 raft_consensus.cc:374] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:30.288520 1960 raft_consensus.cc:729] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81eb0339d45549a196658775fe094bae, State: Initialized, Role: FOLLOWER
I20260812 00:00:30.288676 1960 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81eb0339d45549a196658775fe094bae" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45609 } }
I20260812 00:00:30.288764 1960 raft_consensus.cc:388] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:30.288806 1960 raft_consensus.cc:482] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:30.288858 1960 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:30.289340 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 1858
I20260812 00:00:30.289418 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:00:30.289582 26013 external_mini_cluster.cc:1428] Setting key 486c21e6fc3b4e62c2f256a44b7aa582
I20260812 00:00:30.289628 1960 raft_consensus.cc:504] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81eb0339d45549a196658775fe094bae" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45609 } }
I20260812 00:00:30.289757 1960 leader_election.cc:302] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 81eb0339d45549a196658775fe094bae; no voters:
I20260812 00:00:30.290024 1960 leader_election.cc:288] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:00:30.290068 1963 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:30.290244 1963 raft_consensus.cc:686] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae [term 1 LEADER]: Becoming Leader. State: Replica: 81eb0339d45549a196658775fe094bae, State: Running, Role: LEADER
I20260812 00:00:30.290326 1960 sys_catalog.cc:564] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:30.290333 1963 consensus_queue.cc:237] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81eb0339d45549a196658775fe094bae" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45609 } }
I20260812 00:00:30.290786 1970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81eb0339d45549a196658775fe094bae. Latest consensus state: current_term: 1 leader_uuid: "81eb0339d45549a196658775fe094bae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81eb0339d45549a196658775fe094bae" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45609 } } }
I20260812 00:00:30.290875 1970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:30.291458 1967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "81eb0339d45549a196658775fe094bae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81eb0339d45549a196658775fe094bae" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45609 } } }
I20260812 00:00:30.291543 1967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae [sys.catalog]: This master's current role is: LEADER
W20260812 00:00:30.292318 1990 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:00:30.292377 1990 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:00:30.292429 1978 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:30.292577 1978 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:00:30.294552 1978 catalog_manager.cc:1347] Generated new cluster ID: 44529f07cbcf466aa384ba9519e7a413
I20260812 00:00:30.294665 1978 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:00:30.300251 1968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:30.290097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35946 (local address 127.25.103.126:45609)
0812 00:00:30.290534 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:30.290544 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:30.290581 (+ 37us) server_negotiation.cc:407] Connection header received
0812 00:00:30.290700 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:30.290708 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:30.290785 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:30.291060 (+ 275us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:30.291393 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.292710 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.293575 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.294378 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.298398 (+ 4020us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:30.299290 (+ 892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:30.299297 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:30.299297 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:00:30.299527 (+ 230us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:30.299569 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:00:30.299584 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:30.299647 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:30.299740 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 00:00:30.299868 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":119,"threads_started":1}
I20260812 00:00:30.301366 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:00:30.321255 1978 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:00:30.322197 1978 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:30.325176 1978 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 81eb0339d45549a196658775fe094bae: Generated new TSK 0
I20260812 00:00:30.325459 1978 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 00:00:30.360754 2007 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 00:00:30.360855 2007 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 00:00:30.361238 1968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:30.339663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35956 (local address 127.25.103.126:45609)
0812 00:00:30.339724 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:30.339726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:30.339789 (+ 63us) server_negotiation.cc:407] Connection header received
0812 00:00:30.339875 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:30.339876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:30.339887 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:30.339951 (+ 64us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:00:30.340088 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.340611 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.341793 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.342097 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.342160 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:30.342457 (+ 297us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:00:30.360971 (+ 18514us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33149/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 00:00:30.361155 (+ 184us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35956: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33149/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":33}
W20260812 00:00:30.361282 2006 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:30.339549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:45609 (local address 127.0.0.1:35956)
0812 00:00:30.339712 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:30.339724 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:30.339796 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:30.339961 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:30.339962 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:30.339965 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:00:30.340034 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:30.340037 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.340680 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.340681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:30.341688 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:30.341692 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.342173 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.342174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:30.342246 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:30.342253 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:00:30.361098 (+ 18845us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33149/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 00:00:30.361211 (+ 113us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.103.126:45609: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33149/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":96,"threads_started":1}
W20260812 00:00:30.361304 1968 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35956: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33149/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260812 00:00:30.361680 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 1858
2026-08-12T00:00:30Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (271 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 00:00:30.411404 26013 mini_oidc.cc:152] Starting JWKS server
I20260812 00:00:30.412127 26013 webserver.cc:460] Webserver started at https://127.0.0.1:34197/ using document root <none> and password file <none>
I20260812 00:00:30.412174 26013 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 00:00:30.412299 26013 webserver.cc:460] Webserver started at http://127.0.0.1:43973/ using document root <none> and password file <none>
2026-08-12T00:00:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:30Z Disabled control of system clock
I20260812 00:00:30.422230 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:45403
--webserver_interface=127.25.103.126
--webserver_port=0
--builtin_ntp_servers=127.25.103.84:35883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:45403
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34197/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 00:00:30.511576 2019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:30.511843 2019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:30.511879 2019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:30.513159 2019 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:30.513211 2019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:30.513227 2019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:30.513244 2019 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:30.513259 2019 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:00:30.513275 2019 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:00:30.513298 2019 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34197/jwks.json
I20260812 00:00:30.514827 2019 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:45403
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:45403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34197/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:30.515110 2019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:30.515421 2019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:30.521186 2032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:30.521250 2038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:30.521206 2030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:30.521639 2019 server_base.cc:1034] running on GCE node
I20260812 00:00:30.521906 2019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:30.522261 2019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:30.523422 2019 hybrid_clock.cc:648] HybridClock initialized: now 1786492830523402 us; error 35 us; skew 500 ppm
I20260812 00:00:30.524811 2019 webserver.cc:460] Webserver started at http://127.25.103.126:39353/ using document root <none> and password file <none>
I20260812 00:00:30.525053 2019 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:30.525105 2019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:30.525241 2019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:30.526443 2019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "460877cd0f8441a19011b961a155c3b1"
format_stamp: "Formatted at 2026-08-12 00:00:30 on dist-test-slave-vpvm"
server_key: "1207c5b2a1c68ccc256be65ef126c5f8"
server_key_iv: "5c78efadededdd5af32c2e0f928001d2"
server_key_version: "encryptionkey@0"
I20260812 00:00:30.526804 2019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "460877cd0f8441a19011b961a155c3b1"
format_stamp: "Formatted at 2026-08-12 00:00:30 on dist-test-slave-vpvm"
server_key: "1207c5b2a1c68ccc256be65ef126c5f8"
server_key_iv: "5c78efadededdd5af32c2e0f928001d2"
server_key_version: "encryptionkey@0"
I20260812 00:00:30.528255 2019 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:00:30.529132 2049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:30.529518 2019 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:30.529639 2019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "460877cd0f8441a19011b961a155c3b1"
format_stamp: "Formatted at 2026-08-12 00:00:30 on dist-test-slave-vpvm"
server_key: "1207c5b2a1c68ccc256be65ef126c5f8"
server_key_iv: "5c78efadededdd5af32c2e0f928001d2"
server_key_version: "encryptionkey@0"
I20260812 00:00:30.529721 2019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:30.544159 2019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:30.544498 2019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:30.544634 2019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:30.548956 2019 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:45403
I20260812 00:00:30.548992 2128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:45403 every 8 connection(s)
I20260812 00:00:30.549327 2019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:30.549619 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 2019
I20260812 00:00:30.549723 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:00:30.549898 26013 external_mini_cluster.cc:1428] Setting key 382def988beca6e60f41cc74db0cefd2
I20260812 00:00:30.550133 2129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:30.553009 2129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1: Bootstrap starting.
I20260812 00:00:30.553728 2129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:30.554075 2129 log.cc:824] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:30.554823 2129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1: No bootstrap required, opened a new log
I20260812 00:00:30.555953 2132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:30.550788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55884 (local address 127.25.103.126:45403)
0812 00:00:30.550979 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:30.550987 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:30.551011 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:00:30.551478 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:30.551486 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:30.551547 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:30.551675 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:30.551924 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.552798 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.553838 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.554348 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.554463 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:30.555124 (+ 661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:30.555127 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:30.555128 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:00:30.555288 (+ 160us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:30.555321 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:00:30.555331 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:30.555382 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:30.555471 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 00:00:30.555659 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":75,"threads_started":1}
I20260812 00:00:30.557010 2129 raft_consensus.cc:348] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "460877cd0f8441a19011b961a155c3b1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45403 } }
I20260812 00:00:30.557174 2129 raft_consensus.cc:374] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:30.557221 2129 raft_consensus.cc:729] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 460877cd0f8441a19011b961a155c3b1, State: Initialized, Role: FOLLOWER
I20260812 00:00:30.557341 2129 consensus_queue.cc:260] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "460877cd0f8441a19011b961a155c3b1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45403 } }
I20260812 00:00:30.557425 2129 raft_consensus.cc:388] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:30.557466 2129 raft_consensus.cc:482] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:30.557507 2129 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:30.557992 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:00:30.558243 2129 raft_consensus.cc:504] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "460877cd0f8441a19011b961a155c3b1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45403 } }
I20260812 00:00:30.558344 2129 leader_election.cc:302] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 460877cd0f8441a19011b961a155c3b1; no voters:
I20260812 00:00:30.558511 2129 leader_election.cc:288] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:00:30.558984 2140 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:30.559309 2129 sys_catalog.cc:564] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:30.559540 2140 raft_consensus.cc:686] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1 [term 1 LEADER]: Becoming Leader. State: Replica: 460877cd0f8441a19011b961a155c3b1, State: Running, Role: LEADER
I20260812 00:00:30.559851 2140 consensus_queue.cc:237] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "460877cd0f8441a19011b961a155c3b1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45403 } }
I20260812 00:00:30.561084 2142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 460877cd0f8441a19011b961a155c3b1. Latest consensus state: current_term: 1 leader_uuid: "460877cd0f8441a19011b961a155c3b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "460877cd0f8441a19011b961a155c3b1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45403 } } }
I20260812 00:00:30.561185 2142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:30.561079 2141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "460877cd0f8441a19011b961a155c3b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "460877cd0f8441a19011b961a155c3b1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45403 } } }
I20260812 00:00:30.561646 2141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1 [sys.catalog]: This master's current role is: LEADER
W20260812 00:00:30.562150 2159 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:00:30.562206 2159 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:00:30.562422 2160 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:30.562589 2160 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:00:30.564440 2160 catalog_manager.cc:1347] Generated new cluster ID: 2928b474116f47c28b6ffe5a404325cf
I20260812 00:00:30.564489 2160 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:00:30.578912 2160 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:00:30.579763 2160 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:30.586720 2160 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 460877cd0f8441a19011b961a155c3b1: Generated new TSK 0
I20260812 00:00:30.586930 2160 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:00:30.596369 2132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:30.592456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55898 (local address 127.25.103.126:45403)
0812 00:00:30.592510 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:30.592512 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:30.592607 (+ 95us) server_negotiation.cc:407] Connection header received
0812 00:00:30.592658 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:30.592659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:30.592728 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:30.592805 (+ 77us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:00:30.592938 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.593455 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.594596 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.594824 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.594900 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:30.595112 (+ 212us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:00:30.596153 (+ 1041us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34197/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 00:00:30.596292 (+ 139us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55898: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34197/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":27}
W20260812 00:00:30.596453 2132 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55898: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34197/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 00:00:30.598955 2181 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:30.592367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:45403 (local address 127.0.0.1:55898)
0812 00:00:30.592511 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:30.592522 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:30.592594 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:30.592812 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:30.592812 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:30.592814 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:00:30.592876 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:30.592878 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.593519 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.593520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:30.594488 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:30.594491 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.594914 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.594915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:30.594974 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:30.594980 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:00:30.596274 (+ 1294us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34197/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 00:00:30.598652 (+ 2378us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.103.126:45403: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34197/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":1812,"thread_start_us":84,"threads_started":1}
I20260812 00:00:30.600436 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 2019
E20260812 00:00:30.617717 2182 webserver.cc:533] Webserver: sslize failed:
E20260812 00:00:30.617820 2182 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-12T00:00:30Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (236 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T00:00:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:30Z Disabled control of system clock
I20260812 00:00:30.657176 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:44285
--webserver_interface=127.25.103.126
--webserver_port=0
--builtin_ntp_servers=127.25.103.84:34179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:44285
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/testchainca.cert with env {}
W20260812 00:00:30.741806 2190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:30.742082 2190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:30.742121 2190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:30.743368 2190 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:30.743418 2190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:30.743434 2190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:30.743451 2190 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:30.743466 2190 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:00:30.743484 2190 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:00:30.743501 2190 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 00:00:30.745110 2190 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:34179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:44285
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:44285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:30.745361 2190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:30.745566 2190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:30.750845 2197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:30.750856 2199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:30.750845 2205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:30.751084 2190 server_base.cc:1034] running on GCE node
I20260812 00:00:30.751346 2190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:30.751638 2190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:30.752866 2190 hybrid_clock.cc:648] HybridClock initialized: now 1786492830752830 us; error 37 us; skew 500 ppm
I20260812 00:00:30.754693 2190 webserver.cc:460] Webserver started at http://127.25.103.126:40167/ using document root <none> and password file <none>
I20260812 00:00:30.754987 2190 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:30.755043 2190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:30.755174 2190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:30.756381 2190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "c8fdedbec9e34a37852b5032681a4caf"
format_stamp: "Formatted at 2026-08-12 00:00:30 on dist-test-slave-vpvm"
server_key: "b253c05e0da8376b6a21a214748347a5"
server_key_iv: "fbf351a4eb6e60a07b67591d5b608ace"
server_key_version: "encryptionkey@0"
I20260812 00:00:30.756752 2190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "c8fdedbec9e34a37852b5032681a4caf"
format_stamp: "Formatted at 2026-08-12 00:00:30 on dist-test-slave-vpvm"
server_key: "b253c05e0da8376b6a21a214748347a5"
server_key_iv: "fbf351a4eb6e60a07b67591d5b608ace"
server_key_version: "encryptionkey@0"
I20260812 00:00:30.758047 2190 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:00:30.758906 2212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:30.759298 2190 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:30.759392 2190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "c8fdedbec9e34a37852b5032681a4caf"
format_stamp: "Formatted at 2026-08-12 00:00:30 on dist-test-slave-vpvm"
server_key: "b253c05e0da8376b6a21a214748347a5"
server_key_iv: "fbf351a4eb6e60a07b67591d5b608ace"
server_key_version: "encryptionkey@0"
I20260812 00:00:30.759455 2190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:30.775465 2190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:30.775918 2190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:30.776093 2190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:30.780332 2190 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:44285
I20260812 00:00:30.780584 2284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:44285 every 8 connection(s)
I20260812 00:00:30.780736 2190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:30.781775 2285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:30.782902 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 2190
I20260812 00:00:30.782989 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:00:30.783160 26013 external_mini_cluster.cc:1428] Setting key 9879ea7427821d41400b883e5ea96d8f
I20260812 00:00:30.785203 2285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf: Bootstrap starting.
I20260812 00:00:30.785818 2285 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:30.786168 2285 log.cc:824] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:30.786909 2285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf: No bootstrap required, opened a new log
I20260812 00:00:30.788826 2285 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8fdedbec9e34a37852b5032681a4caf" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 44285 } }
I20260812 00:00:30.788976 2285 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:30.789006 2285 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8fdedbec9e34a37852b5032681a4caf, State: Initialized, Role: FOLLOWER
I20260812 00:00:30.789117 2285 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8fdedbec9e34a37852b5032681a4caf" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 44285 } }
I20260812 00:00:30.789211 2285 raft_consensus.cc:388] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:30.789237 2285 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:30.789263 2285 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:30.789789 2285 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8fdedbec9e34a37852b5032681a4caf" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 44285 } }
I20260812 00:00:30.789880 2285 leader_election.cc:302] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8fdedbec9e34a37852b5032681a4caf; no voters:
I20260812 00:00:30.790077 2285 leader_election.cc:288] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:00:30.790120 2291 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:30.790267 2291 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf [term 1 LEADER]: Becoming Leader. State: Replica: c8fdedbec9e34a37852b5032681a4caf, State: Running, Role: LEADER
I20260812 00:00:30.790350 2285 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:30.790366 2291 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8fdedbec9e34a37852b5032681a4caf" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 44285 } }
I20260812 00:00:30.790845 2297 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8fdedbec9e34a37852b5032681a4caf. Latest consensus state: current_term: 1 leader_uuid: "c8fdedbec9e34a37852b5032681a4caf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8fdedbec9e34a37852b5032681a4caf" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 44285 } } }
I20260812 00:00:30.790935 2297 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:30.791127 2295 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8fdedbec9e34a37852b5032681a4caf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8fdedbec9e34a37852b5032681a4caf" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 44285 } } }
I20260812 00:00:30.791181 2309 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:30.791198 2295 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:30.792021 2309 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:00:30.792712 2288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:30.783691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58676 (local address 127.25.103.126:44285)
0812 00:00:30.783865 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:30.783873 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:30.783897 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:00:30.784291 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:30.784297 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:30.784353 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:30.784468 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:30.784750 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.785721 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.786713 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.787139 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.787232 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:30.791717 (+ 4485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:30.791723 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:30.791723 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:00:30.791949 (+ 226us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:30.791994 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:00:30.792010 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:30.792069 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:30.792408 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 00:00:30.792502 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":65,"threads_started":1}
I20260812 00:00:30.793462 2309 catalog_manager.cc:1347] Generated new cluster ID: e0095da465a94eb381ccee7103234ce4
I20260812 00:00:30.793512 2309 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:00:30.794018 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:00:30.823380 2309 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:00:30.824115 2309 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:30.838460 2309 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8fdedbec9e34a37852b5032681a4caf: Generated new TSK 0
I20260812 00:00:30.838696 2309 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:00:30.901638 2288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:30.848616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58680 (local address 127.25.103.126:44285)
0812 00:00:30.848665 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:30.848668 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:30.848751 (+ 83us) server_negotiation.cc:407] Connection header received
0812 00:00:30.848809 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:30.848810 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:30.848824 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:30.848906 (+ 82us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:00:30.849014 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.849785 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.850562 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.850868 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.850936 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:30.851095 (+ 159us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:00:30.901265 (+ 50170us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 00:00:30.901532 (+ 267us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58680: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":26}
W20260812 00:00:30.901754 2288 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58680: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 00:00:30.901788 2331 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:30.848538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:44285 (local address 127.0.0.1:58680)
0812 00:00:30.848680 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:30.848692 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:30.848753 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:30.848903 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:30.848904 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:30.848905 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:00:30.848971 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:30.848974 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.849881 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.849882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:30.850489 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:30.850491 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:30.850958 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:30.850960 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:30.851005 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:30.851010 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:00:30.901514 (+ 50504us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 00:00:30.901679 (+ 165us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.103.126:44285: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":81,"threads_started":1}
I20260812 00:00:30.902351 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 2190
2026-08-12T00:00:30Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (283 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (117 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (103 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:00:31 dist-test-slave-vpvm krb5kdc[2349](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:00:31 dist-test-slave-vpvm krb5kdc[2349](info): set up 2 sockets
Aug 12 00:00:31 dist-test-slave-vpvm krb5kdc[2349](info): commencing operation
krb5kdc: starting...
W20260812 00:00:32.395236 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.243s user 0.002s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:00:32 dist-test-slave-vpvm krb5kdc[2349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:00:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:00:32.543059 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:42679
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:37753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:42679
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:32.636749 2372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:32.637013 2372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:32.637050 2372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:32.638381 2372 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:32.638435 2372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:32.638455 2372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:32.638473 2372 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:32.638489 2372 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:00:32.640179 2372 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:37753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:42679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:42679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:32.640666 2372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:32.641108 2372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:32.647492 2378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:32.647495 2382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:32.647651 2372 server_base.cc:1034] running on GCE node
W20260812 00:00:32.647758 2379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:32.648068 2372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:32.648447 2372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:32.649641 2372 hybrid_clock.cc:648] HybridClock initialized: now 1786492832649622 us; error 40 us; skew 500 ppm
Aug 12 00:00:32 dist-test-slave-vpvm krb5kdc[2349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492832, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:32.652544 2372 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:00:32.653111 2372 webserver.cc:460] Webserver started at http://127.25.103.126:36967/ using document root <none> and password file <none>
I20260812 00:00:32.653338 2372 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:32.653390 2372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:32.653529 2372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:32.654779 2372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "51eff5c8332a4ff29664f741adbf4ff6"
format_stamp: "Formatted at 2026-08-12 00:00:32 on dist-test-slave-vpvm"
server_key: "bcff83d20b4fdfbdbf02ce79079b4047"
server_key_iv: "53ce7529b2872a30a6582e5c5f5b5469"
server_key_version: "encryptionkey@0"
I20260812 00:00:32.655164 2372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "51eff5c8332a4ff29664f741adbf4ff6"
format_stamp: "Formatted at 2026-08-12 00:00:32 on dist-test-slave-vpvm"
server_key: "bcff83d20b4fdfbdbf02ce79079b4047"
server_key_iv: "53ce7529b2872a30a6582e5c5f5b5469"
server_key_version: "encryptionkey@0"
I20260812 00:00:32.656868 2372 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 00:00:32.658490 2392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:32.660241 2372 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 00:00:32.660728 2372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "51eff5c8332a4ff29664f741adbf4ff6"
format_stamp: "Formatted at 2026-08-12 00:00:32 on dist-test-slave-vpvm"
server_key: "bcff83d20b4fdfbdbf02ce79079b4047"
server_key_iv: "53ce7529b2872a30a6582e5c5f5b5469"
server_key_version: "encryptionkey@0"
I20260812 00:00:32.660887 2372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:32.681489 2372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:32.685125 2372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:32.685331 2372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:32.690375 2372 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:42679
I20260812 00:00:32.690539 2473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:42679 every 8 connection(s)
I20260812 00:00:32.690853 2372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:32.691815 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 2372
I20260812 00:00:32.691911 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:00:32.691917 2474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:32.692101 26013 external_mini_cluster.cc:1428] Setting key 96d5a9f82165f5979528e4532db16a6d
I20260812 00:00:32.695343 2474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6: Bootstrap starting.
I20260812 00:00:32.696174 2474 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:32.696534 2474 log.cc:824] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:32.697332 2474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6: No bootstrap required, opened a new log
Aug 12 00:00:32 dist-test-slave-vpvm krb5kdc[2349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:32.700217 2474 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51eff5c8332a4ff29664f741adbf4ff6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42679 } }
I20260812 00:00:32.700407 2474 raft_consensus.cc:374] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:32.700444 2474 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51eff5c8332a4ff29664f741adbf4ff6, State: Initialized, Role: FOLLOWER
I20260812 00:00:32.700640 2474 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51eff5c8332a4ff29664f741adbf4ff6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42679 } }
I20260812 00:00:32.700722 2474 raft_consensus.cc:388] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:32.700788 2474 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:32.700838 2474 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:32.701773 2474 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51eff5c8332a4ff29664f741adbf4ff6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42679 } }
I20260812 00:00:32.701920 2474 leader_election.cc:302] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51eff5c8332a4ff29664f741adbf4ff6; no voters:
I20260812 00:00:32.702168 2474 leader_election.cc:288] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:00:32.702209 2481 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:32.702410 2481 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6 [term 1 LEADER]: Becoming Leader. State: Replica: 51eff5c8332a4ff29664f741adbf4ff6, State: Running, Role: LEADER
I20260812 00:00:32.702561 2474 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:32.702623 2481 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51eff5c8332a4ff29664f741adbf4ff6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42679 } }
I20260812 00:00:32.703173 2483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "51eff5c8332a4ff29664f741adbf4ff6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51eff5c8332a4ff29664f741adbf4ff6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42679 } } }
I20260812 00:00:32.703310 2483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:32.703168 2481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51eff5c8332a4ff29664f741adbf4ff6. Latest consensus state: current_term: 1 leader_uuid: "51eff5c8332a4ff29664f741adbf4ff6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51eff5c8332a4ff29664f741adbf4ff6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42679 } } }
I20260812 00:00:32.703477 2481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:32.705097 2494 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:32.705281 2479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:32.692713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32854 (local address 127.25.103.126:42679)
0812 00:00:32.692893 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:32.692901 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:32.692928 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:00:32.693401 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:32.693409 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:32.693460 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:32.693585 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:32.694507 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:32.695462 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:32.696548 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:32.697028 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:32.697121 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:32.700649 (+ 3528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:32.700657 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:32.700658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:32.700679 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:32.703235 (+ 2556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:32.703708 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:32.703712 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:32.703713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:32.703842 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:32.704049 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:32.704050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:32.704051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:32.704404 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:32.704577 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:32.704852 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 00:00:32.705038 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":71,"threads_started":1}
I20260812 00:00:32.705744 2494 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:00:32.708017 2494 catalog_manager.cc:1347] Generated new cluster ID: 797b12e2b83c436c96d2d8e32e3e5323
I20260812 00:00:32.708107 2494 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:00:32.714641 2494 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:00:32.715382 2494 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:32.718459 2494 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 51eff5c8332a4ff29664f741adbf4ff6: Generated new TSK 0
I20260812 00:00:32.718662 2494 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
I20260812 00:00:32.761516 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42679
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:37753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:32.879518 2519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:32.879812 2519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:32.879845 2519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:32.881724 2519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:32.881796 2519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:32.881834 2519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:00:32.884091 2519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:37753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:32.884426 2519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:32.884711 2519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:00:32.890908 2519 server_base.cc:1034] running on GCE node
W20260812 00:00:32.890949 2530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:32.890959 2528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:32.890929 2534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:32.891436 2519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:32.891723 2519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:32.892901 2519 hybrid_clock.cc:648] HybridClock initialized: now 1786492832892873 us; error 33 us; skew 500 ppm
Aug 12 00:00:32 dist-test-slave-vpvm krb5kdc[2349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492832, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:32.896265 2519 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:00:32.896852 2519 webserver.cc:460] Webserver started at http://127.25.103.65:39667/ using document root <none> and password file <none>
I20260812 00:00:32.897094 2519 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:32.897149 2519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:32.897287 2519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:32.898509 2519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "b1ae80761e994868be534598dd2d4493"
format_stamp: "Formatted at 2026-08-12 00:00:32 on dist-test-slave-vpvm"
server_key: "df94d49235dd776944f50f47f607495b"
server_key_iv: "6ca67a14869d2895729a786312164cfe"
server_key_version: "encryptionkey@0"
I20260812 00:00:32.898871 2519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "b1ae80761e994868be534598dd2d4493"
format_stamp: "Formatted at 2026-08-12 00:00:32 on dist-test-slave-vpvm"
server_key: "df94d49235dd776944f50f47f607495b"
server_key_iv: "6ca67a14869d2895729a786312164cfe"
server_key_version: "encryptionkey@0"
I20260812 00:00:32.900971 2519 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 00:00:32.902275 2546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:32.902674 2519 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:32.902801 2519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "b1ae80761e994868be534598dd2d4493"
format_stamp: "Formatted at 2026-08-12 00:00:32 on dist-test-slave-vpvm"
server_key: "df94d49235dd776944f50f47f607495b"
server_key_iv: "6ca67a14869d2895729a786312164cfe"
server_key_version: "encryptionkey@0"
I20260812 00:00:32.902900 2519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:32.913491 2519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:32.916756 2519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:32.916954 2519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:32.917292 2519 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:32.917725 2519 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:32.917769 2519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:32.917804 2519 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:32.917831 2519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:32.926111 2519 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:36259
I20260812 00:00:32.926221 2728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:36259 every 8 connection(s)
I20260812 00:00:32.926606 2519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:00:32.931419 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 2519
I20260812 00:00:32.931541 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:00:32.931769 26013 external_mini_cluster.cc:1428] Setting key f5befeb81ff75d436edf256ddc2d6371
Aug 12 00:00:32 dist-test-slave-vpvm krb5kdc[2349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492832, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:32.938171 2479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:32.927650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:46951 (local address 127.25.103.126:42679)
0812 00:00:32.927723 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:32.927726 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:32.928068 (+ 342us) server_negotiation.cc:407] Connection header received
0812 00:00:32.929148 (+ 1080us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:32.929149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:32.929164 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:32.929219 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:32.930122 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:32.930674 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:32.932047 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:32.932290 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:32.932359 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:32.935222 (+ 2863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:32.935223 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:32.935224 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:32.935232 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:32.936734 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:32.937168 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:32.937169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:32.937170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:32.937228 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:32.937456 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:32.937457 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:32.937458 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:32.937585 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:32.937646 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:32.937933 (+ 287us) server_negotiation.cc:299] Negotiation successful
0812 00:00:32.938070 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 00:00:32.938359 2731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:32.927645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42679 (local address 127.25.103.65:46951)
0812 00:00:32.927906 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:32.927949 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:32.929019 (+ 1070us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:32.929300 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:32.929304 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:32.929637 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:32.930015 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:32.930023 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:32.930767 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:32.930769 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:32.931953 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:32.931957 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:32.932404 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:32.932405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:32.932696 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:32.933441 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:32.933451 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:32.935107 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:32.936825 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:32.936835 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:32.936838 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:32.937093 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:32.937284 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:32.937285 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:32.937285 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:32.937399 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:32.937642 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:32.937650 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:32.937805 (+ 155us) client_negotiation.cc:769] Sending connection context
0812 00:00:32.937904 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 00:00:32.938114 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":147,"threads_started":1}
I20260812 00:00:32.938952 2729 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42679
I20260812 00:00:32.939056 2729 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:32.939283 2729 heartbeater.cc:511] Master 127.25.103.126:42679 requested a full tablet report, sending...
I20260812 00:00:32.940119 2416 ts_manager.cc:194] Registered new tserver with Master: b1ae80761e994868be534598dd2d4493 (127.25.103.65:36259)
I20260812 00:00:32.940899 2416 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:46951
WARNING: no policy specified for kudu/127.25.103.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
I20260812 00:00:32.961174 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42679
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:37753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:33.054756 2734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:33.055047 2734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:33.055089 2734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:33.056739 2734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:33.056830 2734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:33.056864 2734 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:00:33.058984 2734 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:37753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:33.059311 2734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:33.059589 2734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:33.066066 2742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:33.066213 2741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:33.066066 2745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:33.066401 2734 server_base.cc:1034] running on GCE node
I20260812 00:00:33.066735 2734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:33.067247 2734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:33.068476 2734 hybrid_clock.cc:648] HybridClock initialized: now 1786492833068413 us; error 82 us; skew 500 ppm
Aug 12 00:00:33 dist-test-slave-vpvm krb5kdc[2349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492833, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:33.071573 2734 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:00:33.072132 2734 webserver.cc:460] Webserver started at http://127.25.103.66:35033/ using document root <none> and password file <none>
I20260812 00:00:33.072351 2734 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:33.072404 2734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:33.072537 2734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:33.073654 2734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "af84470ca129424a89341fde41f94777"
format_stamp: "Formatted at 2026-08-12 00:00:33 on dist-test-slave-vpvm"
server_key: "bfd5d45508b5c9bfe7bd906a00f3ccb0"
server_key_iv: "153071809ad809cf4ae52bf5f5cbe203"
server_key_version: "encryptionkey@0"
I20260812 00:00:33.074077 2734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "af84470ca129424a89341fde41f94777"
format_stamp: "Formatted at 2026-08-12 00:00:33 on dist-test-slave-vpvm"
server_key: "bfd5d45508b5c9bfe7bd906a00f3ccb0"
server_key_iv: "153071809ad809cf4ae52bf5f5cbe203"
server_key_version: "encryptionkey@0"
I20260812 00:00:33.075614 2734 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:33.076781 2757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:33.077103 2734 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:33.077216 2734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "af84470ca129424a89341fde41f94777"
format_stamp: "Formatted at 2026-08-12 00:00:33 on dist-test-slave-vpvm"
server_key: "bfd5d45508b5c9bfe7bd906a00f3ccb0"
server_key_iv: "153071809ad809cf4ae52bf5f5cbe203"
server_key_version: "encryptionkey@0"
I20260812 00:00:33.077289 2734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:33.088207 2734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:33.090940 2734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:33.091104 2734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:33.091367 2734 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:33.091711 2734 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:33.091746 2734 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:33.091778 2734 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:33.091796 2734 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:33.099009 2734 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:36179
I20260812 00:00:33.099066 2936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:36179 every 8 connection(s)
I20260812 00:00:33.099618 2734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:00:33 dist-test-slave-vpvm krb5kdc[2349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492833, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:33.108829 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 2734
I20260812 00:00:33.108938 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:00:33.109160 26013 external_mini_cluster.cc:1428] Setting key 95fffe7f229fe395cd97ba402ad9e69a
I20260812 00:00:33.112672 2479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:33.100749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:43735 (local address 127.25.103.126:42679)
0812 00:00:33.100880 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:33.100883 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:33.101178 (+ 295us) server_negotiation.cc:407] Connection header received
0812 00:00:33.102607 (+ 1429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:33.102609 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:33.102628 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:33.102689 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:33.103520 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:33.104082 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:33.105192 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:33.105409 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:33.105471 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:33.108334 (+ 2863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:33.108337 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:33.108337 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:33.108347 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:33.110184 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:33.111120 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:33.111121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:33.111122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:33.111209 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:33.111673 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:33.111674 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:33.111674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:33.111842 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:33.111921 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:33.112372 (+ 451us) server_negotiation.cc:299] Negotiation successful
0812 00:00:33.112492 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:00:33.113057 2941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:33.100625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42679 (local address 127.25.103.66:43735)
0812 00:00:33.100954 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:33.101003 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:33.102467 (+ 1464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:33.102782 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:33.102786 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:33.103146 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:33.103429 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:33.103435 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:33.104172 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:33.104173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:33.105102 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:33.105105 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:33.105487 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:33.105488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:33.105626 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:33.106295 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:33.106305 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:33.108170 (+ 1865us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:33.110331 (+ 2161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:33.110347 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:33.110351 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:33.110978 (+ 627us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:33.111332 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:33.111333 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:33.111334 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:33.111549 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:33.111929 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:33.111936 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:33.112165 (+ 229us) client_negotiation.cc:769] Sending connection context
0812 00:00:33.112309 (+ 144us) client_negotiation.cc:240] Negotiation successful
0812 00:00:33.112750 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":117,"threads_started":1}
I20260812 00:00:33.113665 2938 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42679
I20260812 00:00:33.113803 2938 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:33.114073 2938 heartbeater.cc:511] Master 127.25.103.126:42679 requested a full tablet report, sending...
I20260812 00:00:33.114547 2416 ts_manager.cc:194] Registered new tserver with Master: af84470ca129424a89341fde41f94777 (127.25.103.66:36179)
I20260812 00:00:33.115060 2416 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:43735
WARNING: no policy specified for kudu/127.25.103.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
I20260812 00:00:33.147164 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42679
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:37753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:33.243846 2944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:33.244117 2944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:33.244319 2944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:33.246073 2944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:33.246131 2944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:33.246166 2944 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:00:33.249204 2944 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:37753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2944
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:33.249507 2944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:33.249727 2944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:33.255467 2952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:33.255467 2954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:33.255578 2956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:33.255651 2944 server_base.cc:1034] running on GCE node
I20260812 00:00:33.256023 2944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:33.256575 2944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:33.257827 2944 hybrid_clock.cc:648] HybridClock initialized: now 1786492833257824 us; error 102 us; skew 500 ppm
Aug 12 00:00:33 dist-test-slave-vpvm krb5kdc[2349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492833, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:33.261806 2944 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:00:33.262388 2944 webserver.cc:460] Webserver started at http://127.25.103.67:33923/ using document root <none> and password file <none>
I20260812 00:00:33.262632 2944 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:33.262687 2944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:33.262825 2944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:33.264055 2944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "2d7d6c0641ea40509ce612415a8cc969"
format_stamp: "Formatted at 2026-08-12 00:00:33 on dist-test-slave-vpvm"
server_key: "b35b552f7a4fcd99108a221e12110873"
server_key_iv: "9e9f7a85621b8fc1d807a232b46f4e7a"
server_key_version: "encryptionkey@0"
I20260812 00:00:33.264451 2944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "2d7d6c0641ea40509ce612415a8cc969"
format_stamp: "Formatted at 2026-08-12 00:00:33 on dist-test-slave-vpvm"
server_key: "b35b552f7a4fcd99108a221e12110873"
server_key_iv: "9e9f7a85621b8fc1d807a232b46f4e7a"
server_key_version: "encryptionkey@0"
I20260812 00:00:33.266151 2944 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260812 00:00:33.267423 2967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:33.267671 2944 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:33.267786 2944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "2d7d6c0641ea40509ce612415a8cc969"
format_stamp: "Formatted at 2026-08-12 00:00:33 on dist-test-slave-vpvm"
server_key: "b35b552f7a4fcd99108a221e12110873"
server_key_iv: "9e9f7a85621b8fc1d807a232b46f4e7a"
server_key_version: "encryptionkey@0"
I20260812 00:00:33.267868 2944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:33.295130 2944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:33.297793 2944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:33.298044 2944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:33.298352 2944 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:33.298758 2944 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:33.298799 2944 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:33.298834 2944 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:33.298858 2944 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:33.306753 2944 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:40031
I20260812 00:00:33.306798 3155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:40031 every 8 connection(s)
I20260812 00:00:33.307186 2944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:00:33 dist-test-slave-vpvm krb5kdc[2349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492833, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:33.314716 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 2944
I20260812 00:00:33.314795 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:00:33.314971 26013 external_mini_cluster.cc:1428] Setting key 99717f055065e7b33aa00834383b2259
I20260812 00:00:33.318400 2479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:33.308066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:58073 (local address 127.25.103.126:42679)
0812 00:00:33.308130 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:33.308132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:33.308359 (+ 227us) server_negotiation.cc:407] Connection header received
0812 00:00:33.309319 (+ 960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:33.309320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:33.309332 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:33.309501 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:33.310303 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:33.310860 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:33.312128 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:33.312477 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:33.312553 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:33.315306 (+ 2753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:33.315307 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:33.315308 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:33.315317 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:33.316816 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:33.317247 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:33.317249 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:33.317249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:33.317306 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:33.317563 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:33.317563 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:33.317564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:33.317693 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:33.317750 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:33.318205 (+ 455us) server_negotiation.cc:299] Negotiation successful
0812 00:00:33.318302 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:00:33.318632 3161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:33.307975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42679 (local address 127.25.103.67:58073)
0812 00:00:33.308155 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:33.308200 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:33.309170 (+ 970us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:33.309603 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:33.309607 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:33.309895 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:33.310186 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:33.310191 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:33.310993 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:33.310994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:33.311907 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:33.311910 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:33.312596 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:33.312598 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:33.312743 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:33.313343 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:33.313353 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:33.315178 (+ 1825us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:33.316909 (+ 1731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:33.316918 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:33.316921 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:33.317172 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:33.317364 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:33.317365 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:33.317366 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:33.317495 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:33.317753 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:33.317760 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:33.317912 (+ 152us) client_negotiation.cc:769] Sending connection context
0812 00:00:33.318157 (+ 245us) client_negotiation.cc:240] Negotiation successful
0812 00:00:33.318359 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":80,"threads_started":1}
I20260812 00:00:33.319350 3156 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42679
I20260812 00:00:33.319583 3156 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:33.319880 3156 heartbeater.cc:511] Master 127.25.103.126:42679 requested a full tablet report, sending...
I20260812 00:00:33.320495 2416 ts_manager.cc:194] Registered new tserver with Master: 2d7d6c0641ea40509ce612415a8cc969 (127.25.103.67:40031)
I20260812 00:00:33.320886 2416 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:58073
I20260812 00:00:33.327873 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/test-admin.keytab.
Aug 12 00:00:33 dist-test-slave-vpvm krb5kdc[2349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:33.348272 26013 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 00:00:33.350169 3166 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:33.349183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54936 (local address 127.25.103.65:36259)
0812 00:00:33.349356 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:33.349361 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:33.349372 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:00:33.349401 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:33.349403 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:33.349417 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:33.349492 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:33.350077 (+ 585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54936: BlockingRecv error: recv got EOF from 127.0.0.1:54936 (error 108)
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":95,"threads_started":1}
W20260812 00:00:33.350271 26013 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/krb5cc' of type FILE
Aug 12 00:00:33 dist-test-slave-vpvm krb5kdc[2349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:33.351300 26013 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 00:00:33 dist-test-slave-vpvm krb5kdc[2349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:33.352190 26013 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 00:00:33 dist-test-slave-vpvm krb5kdc[2349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.65@KRBTEST.COM
I20260812 00:00:33.361632 3166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:33.353114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54950 (local address 127.25.103.65:36259)
0812 00:00:33.353194 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:33.353197 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:33.353208 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:00:33.353286 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:33.353288 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:33.353304 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:33.353360 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:33.353918 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:33.354849 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:33.355665 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:33.356063 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:33.356225 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:33.358815 (+ 2590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:33.358827 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:33.358827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:33.358835 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:33.360450 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:33.360793 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:33.360796 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:33.360797 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:33.360855 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:33.361025 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:33.361026 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:33.361026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:33.361188 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:33.361339 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:33.361414 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 00:00:33.361513 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260812 00:00:33.364365 3166 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:33.363633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54962 (local address 127.25.103.65:36259)
0812 00:00:33.363689 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:33.363691 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:33.363834 (+ 143us) server_negotiation.cc:407] Connection header received
0812 00:00:33.363868 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:33.363869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:33.363884 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:33.363947 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:33.364303 (+ 356us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54962: BlockingRecv error: recv got EOF from 127.0.0.1:54962 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260812 00:00:33.364557 26013 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/krb5cc' of type FILE
Aug 12 00:00:33 dist-test-slave-vpvm krb5kdc[2349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:33.365690 26013 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 00:00:33 dist-test-slave-vpvm krb5kdc[2349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:33.366611 26013 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 00:00:33 dist-test-slave-vpvm krb5kdc[2349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.65@KRBTEST.COM
I20260812 00:00:33.374112 3166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:33.367240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54976 (local address 127.25.103.65:36259)
0812 00:00:33.367298 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:33.367300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:33.367310 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:00:33.367378 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:33.367379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:33.367389 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:33.367453 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:33.367833 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:33.368362 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:33.369073 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:33.369285 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:33.369343 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:33.371666 (+ 2323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:33.371668 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:33.371668 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:33.371677 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:33.373025 (+ 1348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:33.373349 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:33.373351 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:33.373351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:33.373407 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:33.373577 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:33.373578 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:33.373578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:33.373693 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:33.373782 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:33.373886 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 00:00:33.374006 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260812 00:00:33.375813 3166 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:33.375325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54986 (local address 127.25.103.65:36259)
0812 00:00:33.375374 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:33.375376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:33.375383 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:00:33.375445 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:33.375446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:33.375455 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:33.375500 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:33.375765 (+ 265us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54986: BlockingRecv error: recv got EOF from 127.0.0.1:54986 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260812 00:00:33.375996 26013 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492802321514-26013-0/krb5kdc/krb5cc)
Aug 12 00:00:33 dist-test-slave-vpvm krb5kdc[2349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:33.377099 26013 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 00:00:33 dist-test-slave-vpvm krb5kdc[2349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:33.378176 26013 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 00:00:33 dist-test-slave-vpvm krb5kdc[2349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.65@KRBTEST.COM
I20260812 00:00:33.387066 3166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:33.378988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55002 (local address 127.25.103.65:36259)
0812 00:00:33.379059 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:33.379061 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:33.379091 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:00:33.379171 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:33.379172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:33.379183 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:33.379229 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:33.379639 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:33.380261 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:33.381233 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:33.381497 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:33.381564 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:33.384232 (+ 2668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:33.384234 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:33.384234 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:33.384246 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:33.385876 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:33.386318 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:33.386319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:33.386319 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:33.386382 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:33.386540 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:33.386541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:33.386542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:33.386666 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:33.386751 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:33.386866 (+ 115us) server_negotiation.cc:299] Negotiation successful
0812 00:00:33.386957 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 00:00:33.388055 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 2519
I20260812 00:00:33.412573 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 2734
I20260812 00:00:33.442237 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 2944
I20260812 00:00:33.505075 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 2372
2026-08-12T00:00:33Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2377 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:00:33 dist-test-slave-vpvm krb5kdc[3185](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:00:33 dist-test-slave-vpvm krb5kdc[3185](info): set up 2 sockets
Aug 12 00:00:33 dist-test-slave-vpvm krb5kdc[3185](info): commencing operation
krb5kdc: starting...
W20260812 00:00:34.746795 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:00:34 dist-test-slave-vpvm krb5kdc[3185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492834, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:00:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:34Z Disabled control of system clock
WARNING: no policy specified for oryx/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.126.keytab.
Entry for principal oryx/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.126.keytab.
I20260812 00:00:34.890878 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:42139
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.126.keytab
--principal=oryx/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:36485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:42139
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:34.989212 3201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:34.989502 3201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:34.989531 3201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:34.991648 3201 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:34.991745 3201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:34.991760 3201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:34.991772 3201 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:34.991784 3201 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:00:34.993753 3201 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:36485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:42139
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.126.keytab
--principal=oryx/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:42139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3201
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:34.994096 3201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:34.994374 3201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:35.000815 3217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:35.000840 3210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:35.000840 3211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:35.001113 3201 server_base.cc:1034] running on GCE node
I20260812 00:00:35.001521 3201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:35.001911 3201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:35.003141 3201 hybrid_clock.cc:648] HybridClock initialized: now 1786492835003116 us; error 42 us; skew 500 ppm
Aug 12 00:00:35 dist-test-slave-vpvm krb5kdc[3185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492835, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:35.006603 3201 init.cc:377] Logged in from keytab as oryx/127.25.103.126@KRBTEST.COM (short username oryx)
I20260812 00:00:35.007165 3201 webserver.cc:460] Webserver started at http://127.25.103.126:34905/ using document root <none> and password file <none>
I20260812 00:00:35.007408 3201 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:35.007464 3201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:35.007602 3201 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:35.008827 3201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "2b7de6cdc99f40c68fa244af0853dac3"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "1433b52d39064116d691a2934beffcf1"
server_key_iv: "d5c91a40b7bdaea658bc19423afd180a"
server_key_version: "encryptionkey@0"
I20260812 00:00:35.009200 3201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "2b7de6cdc99f40c68fa244af0853dac3"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "1433b52d39064116d691a2934beffcf1"
server_key_iv: "d5c91a40b7bdaea658bc19423afd180a"
server_key_version: "encryptionkey@0"
I20260812 00:00:35.010906 3201 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 00:00:35.012310 3224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:35.012629 3201 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:35.012771 3201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "2b7de6cdc99f40c68fa244af0853dac3"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "1433b52d39064116d691a2934beffcf1"
server_key_iv: "d5c91a40b7bdaea658bc19423afd180a"
server_key_version: "encryptionkey@0"
I20260812 00:00:35.012867 3201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:35.021225 3201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:35.023636 3201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:35.023801 3201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:35.028357 3201 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:42139
I20260812 00:00:35.028621 3318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:42139 every 8 connection(s)
I20260812 00:00:35.028827 3201 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:35.030037 3319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:35.033038 3319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3: Bootstrap starting.
I20260812 00:00:35.033749 3319 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:35.034085 3319 log.cc:824] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:35.035076 3319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3: No bootstrap required, opened a new log
I20260812 00:00:35.037472 3319 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } }
I20260812 00:00:35.037681 3319 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:35.037708 3319 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b7de6cdc99f40c68fa244af0853dac3, State: Initialized, Role: FOLLOWER
I20260812 00:00:35.037865 3319 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } }
I20260812 00:00:35.037978 3319 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:35.038010 3319 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:35.038051 3319 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:35.038858 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 3201
I20260812 00:00:35.038971 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:00:35.039072 3319 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } }
I20260812 00:00:35.039150 26013 external_mini_cluster.cc:1428] Setting key 3e199f07132c6b3cfcbb88b961c5d6db
I20260812 00:00:35.039199 3319 leader_election.cc:302] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b7de6cdc99f40c68fa244af0853dac3; no voters:
I20260812 00:00:35.039402 3319 leader_election.cc:288] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:00:35.039433 3324 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:35.039557 3324 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [term 1 LEADER]: Becoming Leader. State: Replica: 2b7de6cdc99f40c68fa244af0853dac3, State: Running, Role: LEADER
I20260812 00:00:35.039675 3324 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } }
I20260812 00:00:35.039753 3319 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:35.040295 3326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b7de6cdc99f40c68fa244af0853dac3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } }
I20260812 00:00:35.040591 3326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:35.040517 3325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b7de6cdc99f40c68fa244af0853dac3. Latest consensus state: current_term: 1 leader_uuid: "2b7de6cdc99f40c68fa244af0853dac3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } }
I20260812 00:00:35.040868 3325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:35.041117 3338 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:35.041807 3338 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:00:35.043877 3338 catalog_manager.cc:1347] Generated new cluster ID: 5ff4f1421ff24408b02670b76d6ca405
I20260812 00:00:35.043962 3338 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:00:35 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492834, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM
I20260812 00:00:35.051337 3330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.040092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55538 (local address 127.25.103.126:42139)
0812 00:00:35.040280 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:35.040291 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:35.040330 (+ 39us) server_negotiation.cc:407] Connection header received
0812 00:00:35.040479 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:35.040488 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:35.040558 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:35.040749 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:35.041878 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.043301 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.044176 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.044684 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.044801 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.047271 (+ 2470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:35.047278 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:35.047278 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:35.047295 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:35.049270 (+ 1975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.049781 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.049786 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.049786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.049917 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.050146 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.050147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.050147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.050491 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:35.050671 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:35.050776 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 00:00:35.051103 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":97,"threads_started":1}
I20260812 00:00:35.052096 3338 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:00:35.053030 3338 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:35.061862 3338 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3: Generated new TSK 0
I20260812 00:00:35.062212 3338 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.65.keytab.
Entry for principal oryx/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.65.keytab.
I20260812 00:00:35.099285 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42139
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.65.keytab
--principal=oryx/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:36485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:35.211946 3355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:35.212196 3355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:35.212224 3355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:35.213536 3355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:35.213595 3355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:35.213624 3355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:00:35.215432 3355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:36485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.65.keytab
--principal=oryx/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:35.215721 3355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:35.215997 3355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:35.222417 3366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:35.222417 3364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:35.222460 3363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:35.222460 3355 server_base.cc:1034] running on GCE node
I20260812 00:00:35.223043 3355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:35.223352 3355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:35.224526 3355 hybrid_clock.cc:648] HybridClock initialized: now 1786492835224509 us; error 35 us; skew 500 ppm
Aug 12 00:00:35 dist-test-slave-vpvm krb5kdc[3185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492835, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:35.227479 3355 init.cc:377] Logged in from keytab as oryx/127.25.103.65@KRBTEST.COM (short username oryx)
I20260812 00:00:35.227989 3355 webserver.cc:460] Webserver started at http://127.25.103.65:40813/ using document root <none> and password file <none>
I20260812 00:00:35.228245 3355 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:35.228298 3355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:35.228425 3355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:35.229578 3355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "a6a1e56a83b4462fb704dfce8f64e27c"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "f134d1bf47a6dee85e5a117dda0a61fd"
server_key_iv: "70def435fa212e7d05c79c9a400330ca"
server_key_version: "encryptionkey@0"
I20260812 00:00:35.229981 3355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "a6a1e56a83b4462fb704dfce8f64e27c"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "f134d1bf47a6dee85e5a117dda0a61fd"
server_key_iv: "70def435fa212e7d05c79c9a400330ca"
server_key_version: "encryptionkey@0"
I20260812 00:00:35.231530 3355 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:35.232586 3379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:35.232996 3355 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:35.233150 3355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "a6a1e56a83b4462fb704dfce8f64e27c"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "f134d1bf47a6dee85e5a117dda0a61fd"
server_key_iv: "70def435fa212e7d05c79c9a400330ca"
server_key_version: "encryptionkey@0"
I20260812 00:00:35.233343 3355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:35.249446 3355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:35.252146 3355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:35.252422 3355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:35.252692 3355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:35.253042 3355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:35.253079 3355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:35.253111 3355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:35.253127 3355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:35.259325 3355 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:45815
I20260812 00:00:35.259408 3567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:45815 every 8 connection(s)
I20260812 00:00:35.259725 3355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:00:35 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492835, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM
I20260812 00:00:35.268241 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 3355
I20260812 00:00:35.268362 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:00:35.268575 26013 external_mini_cluster.cc:1428] Setting key db1efb956d8cf4c274703b57f0204bd7
I20260812 00:00:35.271893 3330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.260661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:60891 (local address 127.25.103.126:42139)
0812 00:00:35.260724 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:35.260726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:35.260902 (+ 176us) server_negotiation.cc:407] Connection header received
0812 00:00:35.261457 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:35.261458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:35.261473 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:35.261540 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:35.262756 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.263296 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.265044 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.265275 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.265353 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.268239 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:35.268242 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:35.268242 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:35.268252 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:35.270100 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.270616 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.270617 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.270618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.270683 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.270907 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.270907 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.270908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.271047 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:35.271118 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:35.271663 (+ 545us) server_negotiation.cc:299] Negotiation successful
0812 00:00:35.271799 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:00:35.272068 3573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.260612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.65:60891)
0812 00:00:35.260778 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:35.260823 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:35.261322 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:35.261655 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:35.261659 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:35.262372 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:35.262600 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:35.262605 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.263522 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.263524 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:35.264866 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:35.264872 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.265407 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.265408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:35.265559 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.266322 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:35.266334 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:35.268074 (+ 1740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:35.270200 (+ 2126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:35.270215 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:35.270217 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:35.270539 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:35.270743 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:35.270743 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:35.270744 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:35.270854 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:35.271157 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:35.271167 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:35.271426 (+ 259us) client_negotiation.cc:769] Sending connection context
0812 00:00:35.271565 (+ 139us) client_negotiation.cc:240] Negotiation successful
0812 00:00:35.271812 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":72,"threads_started":1}
I20260812 00:00:35.272897 3569 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42139
I20260812 00:00:35.273036 3569 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:35.273257 3569 heartbeater.cc:511] Master 127.25.103.126:42139 requested a full tablet report, sending...
I20260812 00:00:35.274041 3257 ts_manager.cc:194] Registered new tserver with Master: a6a1e56a83b4462fb704dfce8f64e27c (127.25.103.65:45815)
I20260812 00:00:35.274997 3257 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:60891
WARNING: no policy specified for oryx/127.25.103.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.66.keytab.
Entry for principal oryx/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.66.keytab.
I20260812 00:00:35.301890 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42139
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.66.keytab
--principal=oryx/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:36485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:35.394551 3576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:35.394791 3576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:35.394827 3576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:35.396098 3576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:35.396155 3576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:35.396193 3576 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:00:35.397820 3576 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:36485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.66.keytab
--principal=oryx/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3576
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:35.398185 3576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:35.398435 3576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:35.404361 3587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:35.404361 3589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:35.404340 3586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:35.404989 3576 server_base.cc:1034] running on GCE node
I20260812 00:00:35.405285 3576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:35.405721 3576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:35.406921 3576 hybrid_clock.cc:648] HybridClock initialized: now 1786492835406882 us; error 53 us; skew 500 ppm
Aug 12 00:00:35 dist-test-slave-vpvm krb5kdc[3185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492835, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:35.410054 3576 init.cc:377] Logged in from keytab as oryx/127.25.103.66@KRBTEST.COM (short username oryx)
I20260812 00:00:35.410601 3576 webserver.cc:460] Webserver started at http://127.25.103.66:43445/ using document root <none> and password file <none>
I20260812 00:00:35.410847 3576 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:35.410897 3576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:35.411019 3576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:35.412163 3576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "e5e971af558d438796045dda98dd4d76"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "3a98dba1d3a9e4e35c338da70fdfeaad"
server_key_iv: "efadc9662d6829199b708ad381cb3127"
server_key_version: "encryptionkey@0"
I20260812 00:00:35.412531 3576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "e5e971af558d438796045dda98dd4d76"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "3a98dba1d3a9e4e35c338da70fdfeaad"
server_key_iv: "efadc9662d6829199b708ad381cb3127"
server_key_version: "encryptionkey@0"
I20260812 00:00:35.414268 3576 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 00:00:35.415236 3597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:35.415553 3576 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:35.415654 3576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "e5e971af558d438796045dda98dd4d76"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "3a98dba1d3a9e4e35c338da70fdfeaad"
server_key_iv: "efadc9662d6829199b708ad381cb3127"
server_key_version: "encryptionkey@0"
I20260812 00:00:35.415755 3576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:35.428750 3576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:35.431133 3576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:35.431267 3576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:35.431483 3576 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:35.431802 3576 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:35.431847 3576 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:35.431872 3576 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:35.431883 3576 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:35.437904 3576 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:34837
I20260812 00:00:35.438043 3784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:34837 every 8 connection(s)
I20260812 00:00:35.438359 3576 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:00:35.439977 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 3576
I20260812 00:00:35.440119 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:00:35.440519 26013 external_mini_cluster.cc:1428] Setting key 10b2f18bf983cec97619a78d25f5c087
Aug 12 00:00:35 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492835, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM
I20260812 00:00:35.450136 3330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.439932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:45119 (local address 127.25.103.126:42139)
0812 00:00:35.440030 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:35.440034 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:35.440051 (+ 17us) server_negotiation.cc:407] Connection header received
0812 00:00:35.440677 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:35.440679 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:35.440694 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:35.440747 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:35.441903 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.442675 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.444042 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.444265 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.444330 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.447166 (+ 2836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:35.447167 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:35.447168 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:35.447177 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:35.448624 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.449113 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.449114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.449115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.449172 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.449408 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.449409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.449410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.449541 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:35.449609 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:35.449906 (+ 297us) server_negotiation.cc:299] Negotiation successful
0812 00:00:35.450032 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
WARNING: no policy specified for oryx/127.25.103.67@KRBTEST.COM; defaulting to no policy
I20260812 00:00:35.450356 3787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.439463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.66:45119)
0812 00:00:35.439759 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:35.439809 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:35.440559 (+ 750us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:35.440830 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:35.440835 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:35.441564 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:35.441798 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:35.441805 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.442871 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.442874 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:35.443929 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:35.443933 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.444352 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.444353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:35.444505 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.445203 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:35.445215 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:35.447020 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:35.448742 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:35.448755 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:35.448758 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:35.449027 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:35.449233 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:35.449234 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:35.449234 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:35.449348 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:35.449609 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:35.449616 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:35.449776 (+ 160us) client_negotiation.cc:769] Sending connection context
0812 00:00:35.449875 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 00:00:35.450112 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":128,"threads_started":1}
I20260812 00:00:35.450961 3785 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42139
I20260812 00:00:35.451072 3785 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:35.451275 3785 heartbeater.cc:511] Master 127.25.103.126:42139 requested a full tablet report, sending...
I20260812 00:00:35.451798 3257 ts_manager.cc:194] Registered new tserver with Master: e5e971af558d438796045dda98dd4d76 (127.25.103.66:34837)
I20260812 00:00:35.452191 3257 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:45119
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.67.keytab.
Entry for principal oryx/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.67.keytab.
I20260812 00:00:35.469697 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42139
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.67.keytab
--principal=oryx/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:36485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:35.566605 3792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:35.566895 3792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:35.566928 3792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:35.568392 3792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:35.568454 3792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:35.568607 3792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:00:35.570731 3792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:36485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.67.keytab
--principal=oryx/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:35.570986 3792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:35.571389 3792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:35.577585 3807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:35.577587 3803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:35.577587 3802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:35.577839 3792 server_base.cc:1034] running on GCE node
I20260812 00:00:35.578083 3792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:35.578364 3792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:35.579612 3792 hybrid_clock.cc:648] HybridClock initialized: now 1786492835579570 us; error 82 us; skew 500 ppm
Aug 12 00:00:35 dist-test-slave-vpvm krb5kdc[3185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492835, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:35.582453 3792 init.cc:377] Logged in from keytab as oryx/127.25.103.67@KRBTEST.COM (short username oryx)
I20260812 00:00:35.582994 3792 webserver.cc:460] Webserver started at http://127.25.103.67:37227/ using document root <none> and password file <none>
I20260812 00:00:35.583240 3792 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:35.583293 3792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:35.583439 3792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:35.584599 3792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "1b4242e62e514c92b33c2d883d3c3e4a"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "52bad4106402f346adde844342389e2f"
server_key_iv: "40ddcfd6e1c9c7c6226640dcc5c00454"
server_key_version: "encryptionkey@0"
I20260812 00:00:35.584972 3792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "1b4242e62e514c92b33c2d883d3c3e4a"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "52bad4106402f346adde844342389e2f"
server_key_iv: "40ddcfd6e1c9c7c6226640dcc5c00454"
server_key_version: "encryptionkey@0"
I20260812 00:00:35.586472 3792 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:00:35.587366 3821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:35.587713 3792 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:35.587828 3792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "1b4242e62e514c92b33c2d883d3c3e4a"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "52bad4106402f346adde844342389e2f"
server_key_iv: "40ddcfd6e1c9c7c6226640dcc5c00454"
server_key_version: "encryptionkey@0"
I20260812 00:00:35.587913 3792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:35.630357 3792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:35.632628 3792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:35.632786 3792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:35.633037 3792 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:35.633616 3792 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:35.633684 3792 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:35.633724 3792 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:35.633744 3792 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:35.640430 3792 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:45509
I20260812 00:00:35.640486 3999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:45509 every 8 connection(s)
I20260812 00:00:35.640894 3792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:00:35.648056 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 3792
I20260812 00:00:35.648173 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:00:35.648358 26013 external_mini_cluster.cc:1428] Setting key 7890fe3a4e28d96c87f4ae696812b405
Aug 12 00:00:35 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492835, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM
I20260812 00:00:35.652690 3330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.642086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:52139 (local address 127.25.103.126:42139)
0812 00:00:35.642156 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:35.642159 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:35.642482 (+ 323us) server_negotiation.cc:407] Connection header received
0812 00:00:35.643202 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:35.643205 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:35.643220 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:35.643307 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:35.644530 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.645055 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.646434 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.646676 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.646764 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.649840 (+ 3076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:35.649842 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:35.649842 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:35.649852 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:35.651264 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.651742 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.651743 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.651743 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.651812 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.652035 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.652035 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.652036 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.652170 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:35.652229 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:35.652531 (+ 302us) server_negotiation.cc:299] Negotiation successful
0812 00:00:35.652618 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:00:35.652812 4008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.642062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.67:52139)
0812 00:00:35.642260 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:35.642312 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:35.643045 (+ 733us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:35.643386 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:35.643391 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:35.644114 (+ 723us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:35.644392 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:35.644397 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.645220 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.645222 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:35.646261 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:35.646267 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.646815 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.646817 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:35.646961 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.647586 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:35.647595 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:35.649704 (+ 2109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:35.651358 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:35.651368 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:35.651370 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:35.651647 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:35.651875 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:35.651875 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:35.651875 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:35.651980 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:35.652221 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:35.652224 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:35.652364 (+ 140us) client_negotiation.cc:769] Sending connection context
0812 00:00:35.652449 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 00:00:35.652607 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":93,"threads_started":1}
I20260812 00:00:35.653354 4001 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42139
I20260812 00:00:35.653556 4001 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:35.653820 4001 heartbeater.cc:511] Master 127.25.103.126:42139 requested a full tablet report, sending...
I20260812 00:00:35.654431 3257 ts_manager.cc:194] Registered new tserver with Master: 1b4242e62e514c92b33c2d883d3c3e4a (127.25.103.67:45509)
I20260812 00:00:35.655020 3257 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:52139
I20260812 00:00:35.661646 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.25.103.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.103.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.103.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.125.keytab.
Entry for principal oryx/127.25.103.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.125.keytab.
I20260812 00:00:35.694386 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.125:33621
--webserver_interface=127.25.103.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.125.keytab
--principal=oryx/127.25.103.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:36485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:42139,127.25.103.125:33621
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:35.784828 4016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:35.785086 4016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:35.785120 4016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:35.786439 4016 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:35.786492 4016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:35.786513 4016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:35.786530 4016 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:35.786556 4016 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:00:35.788208 4016 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:36485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:42139,127.25.103.125:33621
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.125.keytab
--principal=oryx/127.25.103.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.125:33621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.103.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
W20260812 00:00:35.788348 4016 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.25.103.126:42139,127.25.103.125:33621'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 00:00:35.788522 4016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:35.788757 4016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:00:35.794234 4016 server_base.cc:1034] running on GCE node
W20260812 00:00:35.794322 4024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:35.794236 4025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:35.794234 4028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:35.794790 4016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:35.795115 4016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:35.796288 4016 hybrid_clock.cc:648] HybridClock initialized: now 1786492835796274 us; error 34 us; skew 500 ppm
Aug 12 00:00:35 dist-test-slave-vpvm krb5kdc[3185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492835, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:35.802822 4016 init.cc:377] Logged in from keytab as oryx/127.25.103.125@KRBTEST.COM (short username oryx)
I20260812 00:00:35.803412 4016 webserver.cc:460] Webserver started at http://127.25.103.125:35209/ using document root <none> and password file <none>
I20260812 00:00:35.803653 4016 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:35.803711 4016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:35.803939 4016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:35.805133 4016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/data/instance:
uuid: "482b3ae12a0c41dba76f5a3cb648737b"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "e8a22cade902ccd080428911062202ba"
server_key_iv: "2ebf1ffc668f70f2953da46102327e83"
server_key_version: "encryptionkey@0"
I20260812 00:00:35.805505 4016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/wal/instance:
uuid: "482b3ae12a0c41dba76f5a3cb648737b"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "e8a22cade902ccd080428911062202ba"
server_key_iv: "2ebf1ffc668f70f2953da46102327e83"
server_key_version: "encryptionkey@0"
I20260812 00:00:35.807081 4016 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:00:35.808395 4039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:35.808722 4016 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:00:35.808845 4016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/wal
uuid: "482b3ae12a0c41dba76f5a3cb648737b"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "e8a22cade902ccd080428911062202ba"
server_key_iv: "2ebf1ffc668f70f2953da46102327e83"
server_key_version: "encryptionkey@0"
I20260812 00:00:35.808931 4016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:35.834226 4016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:35.836545 4016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:35.836702 4016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:35.841176 4016 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.125:33621
I20260812 00:00:35.841233 4120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.125:33621 every 8 connection(s)
I20260812 00:00:35.841606 4016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/data/info.pb
I20260812 00:00:35.841807 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 4016
I20260812 00:00:35.843001 4122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:35.845052 4122 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:00:35 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492834, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.103.125@KRBTEST.COM
Aug 12 00:00:35 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492835, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.125@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM
I20260812 00:00:35.855260 4125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.842719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33210 (local address 127.25.103.125:33621)
0812 00:00:35.842936 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:35.842947 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:35.842981 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:00:35.843602 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:35.843612 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:35.843681 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:35.843839 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:35.844476 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.845806 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.846857 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.847556 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.847650 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.851115 (+ 3465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:35.851123 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:35.851123 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:35.851133 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:35.853038 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.853562 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.853566 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.853567 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.853805 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.854164 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.854165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.854165 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.854592 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:35.854760 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:35.854885 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 00:00:35.855039 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":98,"threads_started":1}
I20260812 00:00:35.855656 3330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.846038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55550 (local address 127.25.103.126:42139)
0812 00:00:35.846090 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:35.846092 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:35.846355 (+ 263us) server_negotiation.cc:407] Connection header received
0812 00:00:35.846580 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:35.846583 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:35.846601 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:35.846661 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:35.847457 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.848144 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.849241 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.849560 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.849625 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.852801 (+ 3176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:35.852804 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:35.852804 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:35.852817 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:35.854155 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.854623 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.854624 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.854624 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.854700 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.854949 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.854950 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.854950 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.855177 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:35.855246 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:35.855456 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 00:00:35.855550 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:00:35.856005 4126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.846021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.0.0.1:55550)
0812 00:00:35.846245 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:35.846286 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:35.846357 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:35.846713 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:35.846718 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:35.847219 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:35.847315 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:35.847317 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.848307 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.848309 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:35.849091 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:35.849094 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.849672 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.849674 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:35.849772 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.850524 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:35.850540 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:35.852591 (+ 2051us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:35.854240 (+ 1649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:35.854246 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:35.854249 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:35.854520 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:35.854801 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:35.854802 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:35.854803 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:35.854885 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:35.855247 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:35.855256 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:35.855314 (+ 58us) client_negotiation.cc:769] Sending connection context
0812 00:00:35.855745 (+ 431us) client_negotiation.cc:240] Negotiation successful
0812 00:00:35.855912 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":145,"threads_started":1}
I20260812 00:00:35.856899 4122 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:00:35 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492835, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.125@KRBTEST.COM for oryx/127.25.103.125@KRBTEST.COM
I20260812 00:00:35.865062 4126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.857226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:33621 (local address 127.0.0.1:33216)
0812 00:00:35.857306 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:35.857317 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:35.857370 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:35.857685 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:35.857686 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:35.857827 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:35.857871 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:35.857873 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.858575 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.858576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:35.859079 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:35.859081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.859604 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.859605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:35.859782 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.860282 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:35.860288 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:35.861849 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:35.863761 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:35.863762 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:35.863762 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:35.863947 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:35.864178 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:35.864179 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:35.864179 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:35.864245 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:35.864548 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:35.864549 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:35.864727 (+ 178us) client_negotiation.cc:769] Sending connection context
0812 00:00:35.864825 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 00:00:35.864967 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260812 00:00:35.865201 4125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.857319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33216 (local address 127.25.103.125:33621)
0812 00:00:35.857378 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:35.857380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:35.857389 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:35.857611 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:35.857612 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:35.857621 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:35.857672 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:35.857979 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.858479 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.859169 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.859385 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.859566 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.862045 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:35.862046 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:35.862047 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:35.862056 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:35.863658 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.864034 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.864035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.864036 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.864096 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.864315 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.864316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.864316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.864452 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:35.864523 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:35.864875 (+ 352us) server_negotiation.cc:299] Negotiation successful
0812 00:00:35.865098 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":101,"server-negotiator.queue_time_us":33}
I20260812 00:00:35.867123 4122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: Bootstrap starting.
I20260812 00:00:35.867991 4122 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:35.868238 4122 log.cc:824] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:35.869030 4122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: No bootstrap required, opened a new log
I20260812 00:00:35.870553 4122 raft_consensus.cc:348] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } }
I20260812 00:00:35.870704 4122 raft_consensus.cc:374] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:35.870729 4122 raft_consensus.cc:729] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482b3ae12a0c41dba76f5a3cb648737b, State: Initialized, Role: FOLLOWER
I20260812 00:00:35.870842 4122 consensus_queue.cc:260] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } }
I20260812 00:00:35.871163 4122 sys_catalog.cc:564] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:35.871304 4129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } } }
I20260812 00:00:35.871413 4129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [sys.catalog]: This master's current role is: FOLLOWER
W20260812 00:00:35.873014 4148 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:00:35.873091 4148 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:00:35.875321 4016 master_runner.cc:428] Detected that this master 482b3ae12a0c41dba76f5a3cb648737b is joining an existing cluster
I20260812 00:00:35.875419 4016 master_runner.cc:432] Initiating AddMaster RPC to add 127.25.103.125:33621
I20260812 00:00:35.886162 4161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.876702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:33621 (local address 127.0.0.1:33218)
0812 00:00:35.876872 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:35.876881 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:35.876950 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:35.877465 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:35.877465 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:35.877876 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:35.877945 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:35.877989 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.878864 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.878865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:35.879810 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:35.879814 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.880363 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.880364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:35.880434 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.881428 (+ 994us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:35.881436 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:35.881938 (+ 502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:35.884504 (+ 2566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:35.884505 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:35.884505 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:35.884767 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:35.884988 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:35.884988 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:35.884989 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:35.885046 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:35.885455 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:35.885456 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:35.885548 (+ 92us) client_negotiation.cc:769] Sending connection context
0812 00:00:35.885640 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 00:00:35.885922 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":147,"thread_start_us":92,"threads_started":1}
I20260812 00:00:35.886123 4125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.876892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33218 (local address 127.25.103.125:33621)
0812 00:00:35.876940 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:35.876942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:35.876955 (+ 13us) server_negotiation.cc:407] Connection header received
0812 00:00:35.877204 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:35.877205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:35.877215 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:35.877429 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:35.878089 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.878733 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.879932 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.880229 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.880296 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.882105 (+ 1809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:35.882107 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:35.882108 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:35.882115 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:35.884175 (+ 2060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.884848 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.884850 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.884851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.884915 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.885135 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.885137 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.885137 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.885342 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:35.885437 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:35.885679 (+ 242us) server_negotiation.cc:299] Negotiation successful
0812 00:00:35.885824 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":20}
I20260812 00:00:35.887918 3330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.876703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55562 (local address 127.25.103.126:42139)
0812 00:00:35.876767 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:35.876769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:35.876920 (+ 151us) server_negotiation.cc:407] Connection header received
0812 00:00:35.877058 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:35.877060 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:35.877074 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:35.877143 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:35.877719 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.878637 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.879913 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.880234 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.880297 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.883137 (+ 2840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:35.883140 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:35.883140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:35.883151 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:35.885853 (+ 2702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.887030 (+ 1177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.887032 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.887032 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.887139 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.887340 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.887341 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.887341 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.887482 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:35.887555 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:35.887715 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 00:00:35.887817 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:00:35.887936 4160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.876442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.0.0.1:55562)
0812 00:00:35.876787 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:35.876802 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:35.876950 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:35.877195 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:35.877197 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:35.877380 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:35.877495 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:35.877499 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.878774 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.878776 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:35.879796 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:35.879799 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.880378 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.880379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:35.880618 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.882459 (+ 1841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:35.882465 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:35.882989 (+ 524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:35.885989 (+ 3000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:35.885990 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:35.885990 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:35.886887 (+ 897us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:35.887207 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:35.887208 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:35.887208 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:35.887279 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:35.887548 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:35.887549 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:35.887617 (+ 68us) client_negotiation.cc:769] Sending connection context
0812 00:00:35.887675 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 00:00:35.887817 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":74,"thread_start_us":112,"threads_started":1}
Aug 12 00:00:35 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492835, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.126@KRBTEST.COM for oryx/127.25.103.125@KRBTEST.COM
I20260812 00:00:35.900558 4162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.891043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:33621 (local address 127.0.0.1:33234)
0812 00:00:35.891269 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:35.891339 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:35.891426 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:35.891658 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:35.891662 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:35.892065 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:35.892146 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:35.892149 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.892799 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.892799 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:35.893865 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:35.893869 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.894318 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.894319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:35.894418 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.895097 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:35.895102 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:35.896900 (+ 1798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:35.898862 (+ 1962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:35.898877 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:35.898880 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:35.899207 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:35.899608 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:35.899609 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:35.899609 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:35.899690 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:35.900047 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:35.900055 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:35.900134 (+ 79us) client_negotiation.cc:769] Sending connection context
0812 00:00:35.900241 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 00:00:35.900436 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":115,"threads_started":1}
I20260812 00:00:35.900581 4125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.891139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33234 (local address 127.25.103.125:33621)
0812 00:00:35.891194 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:35.891196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:35.891405 (+ 209us) server_negotiation.cc:407] Connection header received
0812 00:00:35.891531 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:35.891532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:35.891544 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:35.891574 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:35.892247 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.892730 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.894056 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.894246 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.894304 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.897035 (+ 2731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:35.897037 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:35.897037 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:35.897045 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:35.898700 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.899350 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.899352 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.899352 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.899510 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.899790 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.899791 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.899791 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.899970 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:35.900048 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:35.900303 (+ 255us) server_negotiation.cc:299] Negotiation successful
0812 00:00:35.900415 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:00:35.901551 3257 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.25.103.125:33621: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b"
member_type: NON_VOTER
last_known_addr {
host: "127.25.103.125"
port: 33621
}
attrs {
promote: true
}
}
dest_uuid: "2b7de6cdc99f40c68fa244af0853dac3"
cas_config_opid_index: -1
I20260812 00:00:35.902387 3257 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: NON_VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: true } }
I20260812 00:00:35.903110 4164 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 482b3ae12a0c41dba76f5a3cb648737b (127.25.103.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: NON_VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: true } } }
I20260812 00:00:35.903750 4078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:35.904844 4164 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.25.103.125:33621
I20260812 00:00:35.904973 4164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2b7de6cdc99f40c68fa244af0853dac3" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: NON_VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: true } } }
I20260812 00:00:35.905045 4164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:35.905050 4078 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 1 FOLLOWER]: Refusing update from remote peer 2b7de6cdc99f40c68fa244af0853dac3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 00:00:35.905387 4016 master.cc:537] Master@127.25.103.125:33621 shutting down...
I20260812 00:00:35.905664 4165 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: NON_VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 00:00:35.907538 3231 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260812 00:00:35.908815 3231 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 -> Peer 482b3ae12a0c41dba76f5a3cb648737b (127.25.103.125:33621): Couldn't send request to peer 482b3ae12a0c41dba76f5a3cb648737b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 00:00:35.909535 4016 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:35.909668 4016 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:35.909729 4016 tablet_replica.cc:330] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: stopping tablet replica
W20260812 00:00:35.912140 4043 connection.cc:441] server connection from 127.0.0.1:33210 torn down before Call kudu.master.MasterService.ListTables from 127.0.0.1:33210 (request call id 25) could send its response
I20260812 00:00:35.924571 4016 master.cc:552] Master@127.25.103.125:33621 shutdown complete.
I20260812 00:00:35.924683 4016 master_runner.cc:305] Clearing existing system tablet
I20260812 00:00:35.924853 4016 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:35.924916 4016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:35.925633 4016 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.002s sys 0.000s
I20260812 00:00:35.926144 4171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:35.926265 4016 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:35.926352 4016 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:35.926380 4016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/wal
uuid: "482b3ae12a0c41dba76f5a3cb648737b"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "e8a22cade902ccd080428911062202ba"
server_key_iv: "2ebf1ffc668f70f2953da46102327e83"
server_key_version: "encryptionkey@0"
I20260812 00:00:35.928041 4016 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:35.929847 4016 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 00:00:35.929998 4016 log.cc:1196] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 00:00:35.930230 4016 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: Deleting consensus metadata
I20260812 00:00:35.930379 4016 master_runner.cc:315] Copying system tablet from 127.25.103.126:42139
I20260812 00:00:35.931098 4016 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.103.126:42139
I20260812 00:00:35.938057 4179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.931550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.0.0.1:55576)
0812 00:00:35.931715 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:35.931727 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:35.931797 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:35.931915 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:35.931915 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:35.932131 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:35.932195 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:35.932197 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.932872 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.932873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:35.933448 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:35.933450 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.933812 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.933813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:35.933877 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.934524 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:35.934529 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:35.934857 (+ 328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:35.936673 (+ 1816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:35.936675 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:35.936675 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:35.936981 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:35.937250 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:35.937251 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:35.937251 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:35.937318 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:35.937612 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:35.937613 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:35.937672 (+ 59us) client_negotiation.cc:769] Sending connection context
0812 00:00:35.937730 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 00:00:35.937884 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":99,"threads_started":1}
I20260812 00:00:35.938038 3330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:35.931682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55576 (local address 127.25.103.126:42139)
0812 00:00:35.931749 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:35.931751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:35.931779 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:00:35.931853 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:35.931854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:35.931864 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:35.931910 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:35.932272 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.932794 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.933551 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:35.933748 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:35.933807 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:35.934963 (+ 1156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:35.934965 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:35.934965 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:35.934974 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:35.936387 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.937072 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.937075 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.937075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.937171 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:35.937378 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:35.937379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:35.937388 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:35.937549 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:35.937618 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:35.937762 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 00:00:35.937886 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:00:35.938452 3294 tablet_copy_service.cc:140] P 2b7de6cdc99f40c68fa244af0853dac3: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 482b3ae12a0c41dba76f5a3cb648737b ({username='oryx', principal='oryx/127.25.103.125@KRBTEST.COM'} at 127.0.0.1:55576)
I20260812 00:00:35.938555 3294 tablet_copy_service.cc:161] P 2b7de6cdc99f40c68fa244af0853dac3: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 482b3ae12a0c41dba76f5a3cb648737b at {username='oryx', principal='oryx/127.25.103.125@KRBTEST.COM'} at 127.0.0.1:55576: session id = 482b3ae12a0c41dba76f5a3cb648737b-00000000000000000000000000000000
I20260812 00:00:35.939533 3294 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 00:00:35.940568 4016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 00:00:35.942389 4016 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: tablet copy: Starting download of 0 data blocks...
I20260812 00:00:35.942580 4016 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: tablet copy: Starting download of 1 WAL segments...
I20260812 00:00:35.943764 4016 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 00:00:35.944788 3294 tablet_copy_service.cc:342] P 2b7de6cdc99f40c68fa244af0853dac3: Request end of tablet copy session 482b3ae12a0c41dba76f5a3cb648737b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.25.103.125@KRBTEST.COM'} at 127.0.0.1:55576
I20260812 00:00:35.944854 3294 tablet_copy_service.cc:433] P 2b7de6cdc99f40c68fa244af0853dac3: ending tablet copy session 482b3ae12a0c41dba76f5a3cb648737b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 482b3ae12a0c41dba76f5a3cb648737b
I20260812 00:00:35.948190 4016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:35.949738 4182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:35.949731 4180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:35.955224 4184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:35.955238 4016 server_base.cc:1034] running on GCE node
I20260812 00:00:35.955626 4016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:35.955792 4016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:35.956936 4016 hybrid_clock.cc:648] HybridClock initialized: now 1786492835956938 us; error 50 us; skew 500 ppm
Aug 12 00:00:35 dist-test-slave-vpvm krb5kdc[3185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492835, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:35.958591 4016 init.cc:377] Logged in from keytab as oryx/127.25.103.125@KRBTEST.COM (short username oryx)
I20260812 00:00:35.958941 4016 webserver.cc:460] Webserver started at http://127.25.103.125:40119/ using document root <none> and password file <none>
I20260812 00:00:35.959079 4016 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:35.959124 4016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:35.959985 4016 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:35.960786 4197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:35.960934 4016 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:35.960976 4016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/wal
uuid: "482b3ae12a0c41dba76f5a3cb648737b"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "e8a22cade902ccd080428911062202ba"
server_key_iv: "2ebf1ffc668f70f2953da46102327e83"
server_key_version: "encryptionkey@0"
I20260812 00:00:35.961038 4016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:35.971853 4016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:35.973394 4016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:35.976440 4016 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.125:33621
I20260812 00:00:35.976743 4290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.125:33621 every 8 connection(s)
I20260812 00:00:35.976787 4016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-1/data/info.pb
I20260812 00:00:35.977802 4291 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:00:35.978750 4291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: Bootstrap starting.
I20260812 00:00:35.982677 4291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:00:35.982939 4291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: Bootstrap complete.
I20260812 00:00:35.983204 4291 raft_consensus.cc:348] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: NON_VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: true } }
I20260812 00:00:35.983470 4291 raft_consensus.cc:729] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 482b3ae12a0c41dba76f5a3cb648737b, State: Initialized, Role: LEARNER
I20260812 00:00:35.983606 4291 consensus_queue.cc:260] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: NON_VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: true } }
I20260812 00:00:35.984035 4291 sys_catalog.cc:564] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:35.984058 4295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: NON_VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: true } } }
I20260812 00:00:35.984194 4295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [sys.catalog]: This master's current role is: LEARNER
I20260812 00:00:35.985791 4311 catalog_manager.cc:1259] Loaded cluster ID: 5ff4f1421ff24408b02670b76d6ca405
I20260812 00:00:35.985841 4311 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: loading cluster ID for follower catalog manager: success
I20260812 00:00:35.987228 4311 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: acquiring CA information for follower catalog manager: success
I20260812 00:00:35.987748 4311 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:00:36.022217 4313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.013793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33242 (local address 127.25.103.125:33621)
0812 00:00:36.013989 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.013990 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.013999 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:36.014023 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.014024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.014032 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.014095 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.014700 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.015500 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.016750 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.017072 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.017265 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.019005 (+ 1740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.019007 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.019008 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.019018 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.020650 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.021068 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.021069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.021069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.021136 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.021448 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.021450 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.021450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.021616 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.021764 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.021875 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.022039 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":77,"threads_started":1}
WARNING: no policy specified for oryx/127.25.103.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.103.124@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.103.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.124.keytab.
Entry for principal oryx/127.25.103.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.124.keytab.
I20260812 00:00:36.058264 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.124:36953
--webserver_interface=127.25.103.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.124.keytab
--principal=oryx/127.25.103.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:36485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:42139,127.25.103.125:33621,127.25.103.124:36953
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:36.160867 4317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:36.161166 4317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:36.161199 4317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:36.162650 4317 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:36.162711 4317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:36.162725 4317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:36.162737 4317 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:36.162748 4317 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:00:36.164924 4317 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:36485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:42139,127.25.103.125:33621,127.25.103.124:36953
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.124.keytab
--principal=oryx/127.25.103.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.124:36953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.103.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:36.165202 4317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:36.165441 4317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:36.170938 4335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:36.170953 4337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:36.171077 4334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:36.171176 4317 server_base.cc:1034] running on GCE node
I20260812 00:00:36.171414 4317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:36.171772 4317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:36.172963 4317 hybrid_clock.cc:648] HybridClock initialized: now 1786492836172943 us; error 40 us; skew 500 ppm
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492836, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:36.175979 4317 init.cc:377] Logged in from keytab as oryx/127.25.103.124@KRBTEST.COM (short username oryx)
I20260812 00:00:36.176445 4317 webserver.cc:460] Webserver started at http://127.25.103.124:32791/ using document root <none> and password file <none>
I20260812 00:00:36.176640 4317 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:36.176680 4317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:36.176781 4317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:36.178496 4317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/data/instance:
uuid: "9012954ccccb43edb9937277536b2461"
format_stamp: "Formatted at 2026-08-12 00:00:36 on dist-test-slave-vpvm"
server_key: "78c6f520f508c3631c2017769c16f644"
server_key_iv: "a5096023c316094c088bf1d31069846c"
server_key_version: "encryptionkey@0"
I20260812 00:00:36.178917 4317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/wal/instance:
uuid: "9012954ccccb43edb9937277536b2461"
format_stamp: "Formatted at 2026-08-12 00:00:36 on dist-test-slave-vpvm"
server_key: "78c6f520f508c3631c2017769c16f644"
server_key_iv: "a5096023c316094c088bf1d31069846c"
server_key_version: "encryptionkey@0"
I20260812 00:00:36.180721 4317 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 00:00:36.181726 4354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:36.182065 4317 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:36.182184 4317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/wal
uuid: "9012954ccccb43edb9937277536b2461"
format_stamp: "Formatted at 2026-08-12 00:00:36 on dist-test-slave-vpvm"
server_key: "78c6f520f508c3631c2017769c16f644"
server_key_iv: "a5096023c316094c088bf1d31069846c"
server_key_version: "encryptionkey@0"
I20260812 00:00:36.182279 4317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:36.200376 4317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:36.203266 4317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:36.203442 4317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:36.209370 4317 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.124:36953
I20260812 00:00:36.209412 4437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.124:36953 every 8 connection(s)
I20260812 00:00:36.209924 4317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/data/info.pb
I20260812 00:00:36.211237 4438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:36.214359 4438 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:00:36.217918 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 4317
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492836, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.124@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492834, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.103.124@KRBTEST.COM
I20260812 00:00:36.227777 3330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.215355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55588 (local address 127.25.103.126:42139)
0812 00:00:36.217838 (+ 2483us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.217841 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.218256 (+ 415us) server_negotiation.cc:407] Connection header received
0812 00:00:36.218996 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.218998 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.219011 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.219098 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.219762 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.220497 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.221849 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.222138 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.222201 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.224588 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.224589 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.224590 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.224599 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.226184 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.226591 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.226593 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.226593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.226658 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.226969 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.226970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.226971 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.227127 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.227193 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.227568 (+ 375us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.227672 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2440}
I20260812 00:00:36.227864 4441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.215232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.0.0.1:55588)
0812 00:00:36.218049 (+ 2817us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.218103 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.218874 (+ 771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.219191 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.219196 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.219488 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:36.219673 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.219679 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.220616 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.220617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.221763 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.221765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.222239 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.222241 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.222377 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.222968 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:36.222979 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:36.224492 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:36.226255 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.226261 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.226263 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.226504 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.226728 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.226729 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.226729 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.226876 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.227200 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:36.227205 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:36.227383 (+ 178us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.227507 (+ 124us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.227673 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2763,"mutex_wait_us":173,"thread_start_us":2546,"threads_started":1}
I20260812 00:00:36.228407 4438 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:00:36.229125 4442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.219023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41386 (local address 127.25.103.124:36953)
0812 00:00:36.219200 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.219206 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.219230 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:00:36.219249 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.219251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.219271 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.219414 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.220112 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.221307 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.222564 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.222957 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.223035 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.225783 (+ 2748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.225792 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.225792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.225800 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.227441 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.228070 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.228072 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.228073 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.228137 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.228337 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.228338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.228338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.228482 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.228614 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.228944 (+ 330us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.229019 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":97,"threads_started":1}
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492836, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.124@KRBTEST.COM for oryx/127.25.103.125@KRBTEST.COM
I20260812 00:00:36.236016 4313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.228742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33256 (local address 127.25.103.125:33621)
0812 00:00:36.228785 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.228787 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.228794 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:00:36.228822 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.228823 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.228837 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.228885 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.229253 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.229916 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.230657 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.230868 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.230925 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.232905 (+ 1980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.232906 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.232906 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.232914 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.234594 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.235093 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.235095 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.235095 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.235163 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.235334 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.235335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.235336 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.235549 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.235627 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.235804 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.235907 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:00:36.236024 4441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.228662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:33621 (local address 127.0.0.1:33256)
0812 00:00:36.228705 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.228715 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.228751 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.228933 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.228934 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.229091 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:36.229150 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.229152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.230037 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.230038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.230581 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.230582 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.230928 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.230929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.231004 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.231487 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:36.231492 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:36.232788 (+ 1296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:36.234787 (+ 1999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.234789 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.234789 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.235008 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.235225 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.235226 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.235226 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.235281 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.235663 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:36.235664 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:36.235711 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.235768 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.235920 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 00:00:36.236680 4438 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492836, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.124@KRBTEST.COM for oryx/127.25.103.124@KRBTEST.COM
I20260812 00:00:36.244449 4441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.237087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36953 (local address 127.0.0.1:41396)
0812 00:00:36.237147 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.237160 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.237205 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.237392 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.237393 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.237564 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:36.237612 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.237615 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.238412 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.238413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.238901 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.238902 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.239313 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.239314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.239409 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.239951 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:36.239958 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:36.241499 (+ 1541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:36.243087 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.243088 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.243089 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.243262 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.243426 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.243427 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.243427 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.243506 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.244046 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:36.244047 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:36.244130 (+ 83us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.244211 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.244351 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 00:00:36.244550 4442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.237231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41396 (local address 127.25.103.124:36953)
0812 00:00:36.237295 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.237297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.237304 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:00:36.237323 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.237323 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.237335 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.237381 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.237679 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.238337 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.238972 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.239186 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.239318 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.241632 (+ 2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.241633 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.241634 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.241642 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.242999 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.243324 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.243325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.243325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.243373 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.243712 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.243713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.243714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.243870 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.244017 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.244281 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.244415 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":43}
I20260812 00:00:36.246266 4438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: Bootstrap starting.
I20260812 00:00:36.247179 4438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:36.247677 4438 log.cc:824] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:36.248723 4438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: No bootstrap required, opened a new log
I20260812 00:00:36.250485 4438 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } }
I20260812 00:00:36.250648 4438 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:36.250680 4438 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9012954ccccb43edb9937277536b2461, State: Initialized, Role: FOLLOWER
I20260812 00:00:36.250833 4438 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } }
I20260812 00:00:36.251293 4438 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:36.251292 4449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } } }
I20260812 00:00:36.251515 4449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 00:00:36.253065 4466 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:00:36.253118 4466 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:00:36.259680 4317 master_runner.cc:428] Detected that this master 9012954ccccb43edb9937277536b2461 is joining an existing cluster
I20260812 00:00:36.259776 4317 master_runner.cc:432] Initiating AddMaster RPC to add 127.25.103.124:36953
I20260812 00:00:36.269676 3330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.261898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55590 (local address 127.25.103.126:42139)
0812 00:00:36.262006 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.262008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.262080 (+ 72us) server_negotiation.cc:407] Connection header received
0812 00:00:36.262222 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.262224 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.262236 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.262321 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.262979 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.263828 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.264928 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.265257 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.265300 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.266595 (+ 1295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.266596 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.266597 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.266606 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.268482 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.268907 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.268908 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.268909 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.268975 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.269142 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.269143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.269143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.269275 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.269334 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.269475 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.269570 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:00:36.269699 4480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.261776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.0.0.1:55590)
0812 00:00:36.261982 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.261996 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.262080 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.262392 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.262394 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.262740 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:36.262847 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.262851 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.263931 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.263932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.264830 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.264832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.265411 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.265412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.265478 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.266062 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:36.266068 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:36.266489 (+ 421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:36.268619 (+ 2130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.268620 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.268621 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.268834 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.269033 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.269034 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.269034 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.269091 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.269333 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:36.269334 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:36.269385 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.269445 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.269575 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":103,"threads_started":1}
I20260812 00:00:36.276520 3569 heartbeater.cc:503] Master 127.25.103.126:42139 was elected leader, sending a full tablet report...
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492835, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.126@KRBTEST.COM for oryx/127.25.103.124@KRBTEST.COM
I20260812 00:00:36.280989 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 3355
I20260812 00:00:36.298933 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:45815
--local_ip_for_outbound_sockets=127.25.103.65
--tserver_master_addrs=127.25.103.126:42139
--webserver_port=40813
--webserver_interface=127.25.103.65
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.65.keytab
--principal=oryx/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:36485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.25.103.126:42139,127.25.103.125:33621
--tserver_master_addrs=127.25.103.126:42139,127.25.103.125:33621,127.25.103.124:36953 with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:00:36.303550 4481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.262156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:33621 (local address 127.0.0.1:33264)
0812 00:00:36.262315 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.262324 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.262405 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.262611 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.262613 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.262896 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:36.262992 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.262995 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.264013 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.264015 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.265012 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.265015 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.265561 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.265562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.265634 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.299395 (+ 33761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:36.299404 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:36.300021 (+ 617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:36.302198 (+ 2177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.302200 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.302201 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.302490 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.302702 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.302703 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.302703 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.302763 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.303048 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:36.303049 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:36.303099 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.303174 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.303295 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":145,"threads_started":1}
I20260812 00:00:36.303966 4313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.262154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33264 (local address 127.25.103.125:33621)
0812 00:00:36.262234 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.262237 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.262381 (+ 144us) server_negotiation.cc:407] Connection header received
0812 00:00:36.262480 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.262481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.262494 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.262526 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.263103 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.263875 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.265123 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.265431 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.265495 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.300171 (+ 34676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.300174 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.300175 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.300186 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.302057 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.302578 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.302580 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.302580 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.302644 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.302817 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.302818 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.302819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.302964 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.303021 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.303492 (+ 471us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.303574 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:00:36.306349 4162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.272909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36953 (local address 127.0.0.1:41416)
0812 00:00:36.272987 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.273004 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.273061 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.273822 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.273823 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.274091 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:36.274173 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.274176 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.274913 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.274914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.275825 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.275828 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.276235 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.276236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.276316 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.276970 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:36.276977 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:36.278544 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:36.304730 (+ 26186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.304733 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.304734 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.305035 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.305370 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.305373 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.305373 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.305498 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.305931 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:36.305932 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:36.306028 (+ 96us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.306084 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.306243 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 00:00:36.306569 4442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.262486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41402 (local address 127.25.103.124:36953)
0812 00:00:36.262524 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.262525 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.263190 (+ 665us) server_negotiation.cc:407] Connection header received
0812 00:00:36.263261 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.263262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.263271 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.263297 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.263694 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.264388 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.265346 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.265590 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.265627 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.301004 (+ 35377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.301006 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.301006 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.301014 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.303187 (+ 2173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.305635 (+ 2448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.305635 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.305636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.305750 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.305938 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.305939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.305939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.306129 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.306176 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.306357 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.306460 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:00:36.306941 4483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.262580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36953 (local address 127.0.0.1:41402)
0812 00:00:36.263133 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.263142 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.263209 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.263342 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.263343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.263566 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:36.263625 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.263626 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.264474 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.264474 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.265250 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.265253 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.265691 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.265692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.265766 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.300006 (+ 34240us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:36.300011 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:36.300489 (+ 478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:36.305331 (+ 4842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.305332 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.305333 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.305553 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.305809 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.305809 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.305810 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.305879 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.306217 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:36.306218 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:36.306257 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.306712 (+ 455us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.306835 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":102,"threads_started":1}
I20260812 00:00:36.307655 4484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.273166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41416 (local address 127.25.103.124:36953)
0812 00:00:36.273601 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.273604 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.273620 (+ 16us) server_negotiation.cc:407] Connection header received
0812 00:00:36.273677 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.273678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.273703 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.273788 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.274260 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.274822 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.275912 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.276159 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.276230 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.278690 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.278692 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.278692 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.278700 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.304555 (+ 25855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.305154 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.305156 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.305156 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.305245 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.305612 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.305615 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.305615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.305831 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.307387 (+ 1556us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.307440 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.307543 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":171,"threads_started":1}
I20260812 00:00:36.308530 3257 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.25.103.124:36953: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "9012954ccccb43edb9937277536b2461"
member_type: NON_VOTER
last_known_addr {
host: "127.25.103.124"
port: 36953
}
attrs {
promote: true
}
}
dest_uuid: "2b7de6cdc99f40c68fa244af0853dac3"
cas_config_opid_index: 5
I20260812 00:00:36.308871 3257 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: NON_VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: true } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: NON_VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: true } }
I20260812 00:00:36.309681 4165 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 9012954ccccb43edb9937277536b2461 (127.25.103.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: NON_VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: true } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: NON_VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: true } } }
I20260812 00:00:36.311010 4165 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.25.103.124:36953
I20260812 00:00:36.311111 4165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2b7de6cdc99f40c68fa244af0853dac3" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: NON_VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: true } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: NON_VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: true } } }
I20260812 00:00:36.311197 4165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:36.311939 4317 master.cc:537] Master@127.25.103.124:36953 shutting down...
I20260812 00:00:36.312022 4401 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:36.313146 4401 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 1 FOLLOWER]: Refusing update from remote peer 2b7de6cdc99f40c68fa244af0853dac3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 00:00:36.314033 4164 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: NON_VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 00:00:36.315718 3230 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 -> Peer 9012954ccccb43edb9937277536b2461 (127.25.103.124:36953): Couldn't send request to peer 9012954ccccb43edb9937277536b2461. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 00:00:36.316774 4317 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:36.316895 4317 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:36.316943 4317 tablet_replica.cc:330] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: stopping tablet replica
I20260812 00:00:36.317193 4162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.311441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:33621 (local address 127.0.0.1:33274)
0812 00:00:36.311499 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.311511 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.311553 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.311884 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.311885 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.311887 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:36.311958 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.311960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.313301 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.313303 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.315806 (+ 2503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.315812 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.316821 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.316822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.316927 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.316979 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.317028 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.317108 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 00:00:36.317620 4313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.311542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33274 (local address 127.25.103.125:33621)
0812 00:00:36.311591 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.311593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.311603 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:00:36.311636 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.311637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.311667 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.311762 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:36.312037 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.312737 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.315930 (+ 3193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.316615 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.316699 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.316779 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.317489 (+ 710us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.317546 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:00:36.317866 4245 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 1 LEARNER]: Refusing update from remote peer 2b7de6cdc99f40c68fa244af0853dac3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 00:00:36.318118 4164 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: NON_VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 00:00:36.318775 4245 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 9012954ccccb43edb9937277536b2461 (127.25.103.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: NON_VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: true } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: NON_VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: true } } }
I20260812 00:00:36.320217 4295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b7de6cdc99f40c68fa244af0853dac3. Latest consensus state: current_term: 1 leader_uuid: "2b7de6cdc99f40c68fa244af0853dac3" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: NON_VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: true } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: NON_VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: true } } }
I20260812 00:00:36.320317 4295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [sys.catalog]: This master's current role is: LEARNER
I20260812 00:00:36.320353 4295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2b7de6cdc99f40c68fa244af0853dac3" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: NON_VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: true } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: NON_VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: true } } }
I20260812 00:00:36.320399 4295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [sys.catalog]: This master's current role is: LEARNER
I20260812 00:00:36.320909 4164 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3: attempting to promote NON_VOTER 482b3ae12a0c41dba76f5a3cb648737b to VOTER
I20260812 00:00:36.321161 4164 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: NON_VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: true } }
I20260812 00:00:36.321717 4162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.321585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36953 (local address 127.0.0.1:41424)
0812 00:00:36.321630 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.321686 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260812 00:00:36.321906 4245 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 1 LEARNER]: Refusing update from remote peer 2b7de6cdc99f40c68fa244af0853dac3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 00:00:36.322211 4162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.321942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36953 (local address 127.0.0.1:41426)
0812 00:00:36.322162 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.322187 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208}
W20260812 00:00:36.322273 3230 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 -> Peer 9012954ccccb43edb9937277536b2461 (127.25.103.124:36953): Couldn't send request to peer 9012954ccccb43edb9937277536b2461. Status: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 00:00:36.321576 4317 master.cc:552] Master@127.25.103.124:36953 shutdown complete.
I20260812 00:00:36.322332 4317 master_runner.cc:305] Clearing existing system tablet
I20260812 00:00:36.322289 4486 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 00:00:36.322477 4317 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:36.322526 4317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:36.323135 4486 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 482b3ae12a0c41dba76f5a3cb648737b (127.25.103.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: NON_VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: true } } }
I20260812 00:00:36.323222 4317 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:00:36.323653 4490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:36.323736 4317 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:36.323774 4317 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:36.323794 4317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/wal
uuid: "9012954ccccb43edb9937277536b2461"
format_stamp: "Formatted at 2026-08-12 00:00:36 on dist-test-slave-vpvm"
server_key: "78c6f520f508c3631c2017769c16f644"
server_key_iv: "a5096023c316094c088bf1d31069846c"
server_key_version: "encryptionkey@0"
I20260812 00:00:36.324138 4486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2b7de6cdc99f40c68fa244af0853dac3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: NON_VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: true } } }
I20260812 00:00:36.324213 4486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:36.324259 4486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2b7de6cdc99f40c68fa244af0853dac3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: NON_VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: true } } }
I20260812 00:00:36.324301 4486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:36.324616 4317 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:36.324950 4245 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 482b3ae12a0c41dba76f5a3cb648737b (127.25.103.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: NON_VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: true } } }
I20260812 00:00:36.326234 4317 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 00:00:36.326310 4317 log.cc:1196] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 00:00:36.326536 4317 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: Deleting consensus metadata
I20260812 00:00:36.326650 4317 master_runner.cc:315] Copying system tablet from 127.25.103.126:42139
I20260812 00:00:36.327339 4317 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: tablet copy: Beginning tablet copy session from remote peer at address 127.25.103.126:42139
I20260812 00:00:36.327581 4488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2b7de6cdc99f40c68fa244af0853dac3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: NON_VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: true } } }
I20260812 00:00:36.327718 4488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:00:36.336396 3330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.327998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55600 (local address 127.25.103.126:42139)
0812 00:00:36.328071 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.328074 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.328419 (+ 345us) server_negotiation.cc:407] Connection header received
0812 00:00:36.328483 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.328484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.328498 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.328568 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.329106 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.330025 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.331183 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.331557 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.331667 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.333017 (+ 1350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.333019 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.333020 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.333031 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.334976 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.335485 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.335486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.335487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.335564 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.335760 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.335761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.335762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.335918 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.335963 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.336193 (+ 230us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.336289 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:00:36.336855 4499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.328131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.0.0.1:55600)
0812 00:00:36.328297 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.328310 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.328422 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.328581 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.328582 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.328856 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:36.328936 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.328938 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.330165 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.330167 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.331087 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.331090 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.331680 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.331681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.331757 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.332363 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:36.332369 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:36.332887 (+ 518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:36.335122 (+ 2235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.335124 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.335125 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.335395 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.335635 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.335636 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.335636 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.335697 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.336009 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:36.336010 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:36.336065 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.336576 (+ 511us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.336725 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":114,"threads_started":1}
I20260812 00:00:36.337110 3294 tablet_copy_service.cc:140] P 2b7de6cdc99f40c68fa244af0853dac3: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 9012954ccccb43edb9937277536b2461 ({username='oryx', principal='oryx/127.25.103.124@KRBTEST.COM'} at 127.0.0.1:55600)
I20260812 00:00:36.337251 3294 tablet_copy_service.cc:161] P 2b7de6cdc99f40c68fa244af0853dac3: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 9012954ccccb43edb9937277536b2461 at {username='oryx', principal='oryx/127.25.103.124@KRBTEST.COM'} at 127.0.0.1:55600: session id = 9012954ccccb43edb9937277536b2461-00000000000000000000000000000000
I20260812 00:00:36.338075 3294 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 00:00:36.338671 4317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 00:00:36.340076 4317 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: tablet copy: Starting download of 0 data blocks...
I20260812 00:00:36.340225 4317 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: tablet copy: Starting download of 1 WAL segments...
I20260812 00:00:36.341195 4317 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 00:00:36.342232 3294 tablet_copy_service.cc:342] P 2b7de6cdc99f40c68fa244af0853dac3: Request end of tablet copy session 9012954ccccb43edb9937277536b2461-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.25.103.124@KRBTEST.COM'} at 127.0.0.1:55600
I20260812 00:00:36.342303 3294 tablet_copy_service.cc:433] P 2b7de6cdc99f40c68fa244af0853dac3: ending tablet copy session 9012954ccccb43edb9937277536b2461-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 9012954ccccb43edb9937277536b2461
I20260812 00:00:36.345238 4317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:36.346637 4504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:36.347080 4509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:36.350855 4506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:36.351257 4317 server_base.cc:1034] running on GCE node
I20260812 00:00:36.351399 4317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:36.351604 4317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:36.352741 4317 hybrid_clock.cc:648] HybridClock initialized: now 1786492836352728 us; error 40 us; skew 500 ppm
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492836, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:36.355049 4317 init.cc:377] Logged in from keytab as oryx/127.25.103.124@KRBTEST.COM (short username oryx)
I20260812 00:00:36.355602 4317 webserver.cc:460] Webserver started at http://127.25.103.124:36227/ using document root <none> and password file <none>
I20260812 00:00:36.355741 4317 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:36.355783 4317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:36.356714 4317 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:36.357393 4523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:36.357568 4317 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:00:36.357628 4317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/wal
uuid: "9012954ccccb43edb9937277536b2461"
format_stamp: "Formatted at 2026-08-12 00:00:36 on dist-test-slave-vpvm"
server_key: "78c6f520f508c3631c2017769c16f644"
server_key_iv: "a5096023c316094c088bf1d31069846c"
server_key_version: "encryptionkey@0"
I20260812 00:00:36.357698 4317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:36.363396 4317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:36.365236 4317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:36.368593 4317 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.124:36953
I20260812 00:00:36.369030 4317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/master-2/data/info.pb
I20260812 00:00:36.369338 4594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.124:36953 every 8 connection(s)
I20260812 00:00:36.370186 4595 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:00:36.370751 4595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: Bootstrap starting.
I20260812 00:00:36.374424 4595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:00:36.374686 4595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: Bootstrap complete.
I20260812 00:00:36.374918 4595 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: NON_VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: true } }
I20260812 00:00:36.375037 4595 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9012954ccccb43edb9937277536b2461, State: Initialized, Role: LEARNER
I20260812 00:00:36.375090 4595 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: NON_VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: true } }
I20260812 00:00:36.375320 4595 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:36.375351 4599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: NON_VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: true } } }
I20260812 00:00:36.375598 4599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [sys.catalog]: This master's current role is: LEARNER
I20260812 00:00:36.377384 4617 catalog_manager.cc:1259] Loaded cluster ID: 5ff4f1421ff24408b02670b76d6ca405
I20260812 00:00:36.377501 4617 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: loading cluster ID for follower catalog manager: success
I20260812 00:00:36.379240 4617 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: acquiring CA information for follower catalog manager: success
I20260812 00:00:36.379704 4617 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 00:00:36.417645 4485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:36.417886 4485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:36.417923 4485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:36.419518 4485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:36.419579 4485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:36.419625 4485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:00:36.421409 4485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:36485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.65.keytab
--principal=oryx/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:45815
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=40813
--tserver_master_addrs=127.25.103.126:42139,127.25.103.125:33621,127.25.103.124:36953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:36.421720 4485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:36.422009 4485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:36.429689 4626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:36.429638 4485 server_base.cc:1034] running on GCE node
W20260812 00:00:36.429589 4623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:36.429589 4624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:36.430302 4485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:36.430588 4485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:36.431767 4485 hybrid_clock.cc:648] HybridClock initialized: now 1786492836431749 us; error 37 us; skew 500 ppm
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492836, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:36.435477 4485 init.cc:377] Logged in from keytab as oryx/127.25.103.65@KRBTEST.COM (short username oryx)
I20260812 00:00:36.436105 4485 webserver.cc:460] Webserver started at http://127.25.103.65:40813/ using document root <none> and password file <none>
I20260812 00:00:36.436353 4485 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:36.436533 4485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:36.438252 4485 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:00:36.439004 4634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:36.439175 4485 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:36.439271 4485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "a6a1e56a83b4462fb704dfce8f64e27c"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "f134d1bf47a6dee85e5a117dda0a61fd"
server_key_iv: "70def435fa212e7d05c79c9a400330ca"
server_key_version: "encryptionkey@0"
I20260812 00:00:36.439620 4485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:36.453150 4485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:36.453215 3785 heartbeater.cc:503] Master 127.25.103.126:42139 was elected leader, sending a full tablet report...
I20260812 00:00:36.455739 4485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:36.455902 4485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:36.456168 4485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:36.456574 4485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:36.456642 4485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:36.456684 4485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:36.456709 4485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:36.464846 4485 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:45815
I20260812 00:00:36.464916 4815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:45815 every 8 connection(s)
I20260812 00:00:36.465622 4485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:00:36.468920 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 4485
I20260812 00:00:36.469262 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 3576
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492836, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.124@KRBTEST.COM
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492836, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM
I20260812 00:00:36.479341 3330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.467012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:54581 (local address 127.25.103.126:42139)
0812 00:00:36.467072 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.467074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.467509 (+ 435us) server_negotiation.cc:407] Connection header received
0812 00:00:36.467788 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.467789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.467802 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.467857 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.468787 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.469629 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.471555 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.471860 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.471906 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.475610 (+ 3704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.475612 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.475612 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.475621 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.477556 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.478183 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.478185 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.478185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.478247 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.478571 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.478571 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.478572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.478714 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.478767 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.479157 (+ 390us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.479246 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:00:36.479529 4826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.466675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36953 (local address 127.25.103.65:47865)
0812 00:00:36.466889 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.466934 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.467673 (+ 739us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.467941 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.467945 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.468429 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:36.468664 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.468670 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.469920 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.469921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.471395 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.471399 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.471996 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.471997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.472190 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.472872 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:36.472885 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:36.475453 (+ 2568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:36.477643 (+ 2190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.477653 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.477656 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.478152 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.478351 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.478352 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.478352 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.478482 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.478798 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:36.478806 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:36.478996 (+ 190us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.479103 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.479288 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":67,"thread_start_us":98,"threads_started":1}
I20260812 00:00:36.479884 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.466709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:47865 (local address 127.25.103.124:36953)
0812 00:00:36.466847 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.466849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.467062 (+ 213us) server_negotiation.cc:407] Connection header received
0812 00:00:36.467833 (+ 771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.467835 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.467848 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.467917 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.468786 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.469828 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.471525 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.471861 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.471920 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.475607 (+ 3687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.475610 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.475610 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.475621 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.477531 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.478228 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.478229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.478229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.478287 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.478556 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.478557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.478557 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.478715 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.478769 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.479689 (+ 920us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.479789 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":65,"threads_started":1}
I20260812 00:00:36.479895 4829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.466675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.65:54581)
0812 00:00:36.467451 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.467460 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.467680 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.468304 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.468305 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.468505 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:36.468664 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.468670 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.469855 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.469856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.471395 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.471399 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.471999 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.472000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.472189 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.472922 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:36.472927 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:36.475453 (+ 2526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:36.477651 (+ 2198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.477654 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.477656 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.478090 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.478319 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.478319 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.478320 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.478483 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.478799 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:36.478806 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:36.478996 (+ 190us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.479681 (+ 685us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.479790 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":747,"mutex_wait_us":500,"thread_start_us":82,"threads_started":1}
I20260812 00:00:36.480484 4816 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42139
I20260812 00:00:36.480808 4816 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:36.481119 4816 heartbeater.cc:511] Master 127.25.103.126:42139 requested a full tablet report, sending...
I20260812 00:00:36.481716 3257 ts_manager.cc:194] Re-registered known tserver with Master: a6a1e56a83b4462fb704dfce8f64e27c (127.25.103.65:45815)
I20260812 00:00:36.482319 3257 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:54581
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492836, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.125@KRBTEST.COM
I20260812 00:00:36.569052 4817 heartbeater.cc:347] Connected to a master server at 127.25.103.124:36953
I20260812 00:00:36.569120 4817 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:36.569231 4817 heartbeater.cc:511] Master 127.25.103.124:36953 requested a full tablet report, sending...
I20260812 00:00:36.569600 4541 ts_manager.cc:194] Registered new tserver with Master: a6a1e56a83b4462fb704dfce8f64e27c (127.25.103.65:45815)
I20260812 00:00:36.572767 4313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.467440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:41969 (local address 127.25.103.125:33621)
0812 00:00:36.467492 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.467494 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.467594 (+ 100us) server_negotiation.cc:407] Connection header received
0812 00:00:36.467924 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.467925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.467946 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.467995 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.468796 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.469677 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.565279 (+ 95602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.565519 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.565557 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.569934 (+ 4377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.569936 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.569937 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.569983 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.571414 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.571938 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.571940 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.571940 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.572024 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.572240 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.572241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.572242 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.572382 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.572421 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.572595 (+ 174us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.572684 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:00:36.573145 4828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.467329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:33621 (local address 127.25.103.65:41969)
0812 00:00:36.467544 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.467551 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.467680 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.468019 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.468020 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.468410 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:36.468663 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.468668 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.564442 (+ 95774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.564444 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.565154 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.565157 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.565647 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.565648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.565724 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.566357 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:36.566362 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:36.569839 (+ 3477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:36.571549 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.571551 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.571551 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.571833 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.572119 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.572120 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.572120 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.572185 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.572458 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:36.572459 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:36.572505 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.572885 (+ 380us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.573040 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":1,"thread_start_us":61,"threads_started":1}
I20260812 00:00:36.574057 4818 heartbeater.cc:347] Connected to a master server at 127.25.103.125:33621
I20260812 00:00:36.574134 4818 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:36.574195 4818 heartbeater.cc:511] Master 127.25.103.125:33621 requested a full tablet report, sending...
I20260812 00:00:36.574872 4226 ts_manager.cc:194] Registered new tserver with Master: a6a1e56a83b4462fb704dfce8f64e27c (127.25.103.65:45815)
I20260812 00:00:36.579821 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:34837
--local_ip_for_outbound_sockets=127.25.103.66
--tserver_master_addrs=127.25.103.126:42139
--webserver_port=43445
--webserver_interface=127.25.103.66
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.66.keytab
--principal=oryx/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:36485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.25.103.126:42139,127.25.103.125:33621
--tserver_master_addrs=127.25.103.126:42139,127.25.103.125:33621,127.25.103.124:36953 with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:00:36.656246 4001 heartbeater.cc:503] Master 127.25.103.126:42139 was elected leader, sending a full tablet report...
W20260812 00:00:36.679629 4830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:36.679931 4830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:36.679963 4830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:36.681372 4830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:36.681428 4830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:36.681460 4830 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:00:36.683688 4830 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:36485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.66.keytab
--principal=oryx/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:34837
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=43445
--tserver_master_addrs=127.25.103.126:42139,127.25.103.125:33621,127.25.103.124:36953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:36.684008 4830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:36.684252 4830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:36.690531 4840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:36.690621 4844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:36.690582 4830 server_base.cc:1034] running on GCE node
W20260812 00:00:36.690946 4841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:36.691250 4830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:36.691885 4830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:36.693089 4830 hybrid_clock.cc:648] HybridClock initialized: now 1786492836693042 us; error 66 us; skew 500 ppm
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492836, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:36.696785 4830 init.cc:377] Logged in from keytab as oryx/127.25.103.66@KRBTEST.COM (short username oryx)
I20260812 00:00:36.697446 4830 webserver.cc:460] Webserver started at http://127.25.103.66:43445/ using document root <none> and password file <none>
I20260812 00:00:36.697697 4830 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:36.697775 4830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:36.699501 4830 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:00:36.700421 4856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:36.700687 4830 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:36.700805 4830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "e5e971af558d438796045dda98dd4d76"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "3a98dba1d3a9e4e35c338da70fdfeaad"
server_key_iv: "efadc9662d6829199b708ad381cb3127"
server_key_version: "encryptionkey@0"
I20260812 00:00:36.701229 4830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:36.723657 4830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:36.726032 4830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:36.726188 4830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:36.726444 4830 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:36.726773 4830 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:36.726806 4830 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:36.726838 4830 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:36.726855 4830 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:36.734002 4830 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:34837
I20260812 00:00:36.734095 5049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:34837 every 8 connection(s)
I20260812 00:00:36.734452 4830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:00:36.737260 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 4830
I20260812 00:00:36.737555 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 3792
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492836, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.125@KRBTEST.COM
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492836, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492836, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.124@KRBTEST.COM
I20260812 00:00:36.768380 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:45509
--local_ip_for_outbound_sockets=127.25.103.67
--tserver_master_addrs=127.25.103.126:42139
--webserver_port=37227
--webserver_interface=127.25.103.67
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.67.keytab
--principal=oryx/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:36485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.25.103.126:42139,127.25.103.125:33621
--tserver_master_addrs=127.25.103.126:42139,127.25.103.125:33621,127.25.103.124:36953 with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:00:36.768749 4313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.735248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:59437 (local address 127.25.103.125:33621)
0812 00:00:36.735695 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.735697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.735710 (+ 13us) server_negotiation.cc:407] Connection header received
0812 00:00:36.736734 (+ 1024us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.736736 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.736750 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.736804 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.758522 (+ 21718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.759551 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.761368 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.761590 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.761624 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.764574 (+ 2950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.764576 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.764577 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.764585 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.766656 (+ 2071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.767118 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.767119 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.767120 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.767180 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.767416 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.767417 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.767417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.767541 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.767601 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.768391 (+ 790us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.768540 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419}
I20260812 00:00:36.769517 5059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.735264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:33621 (local address 127.25.103.66:59437)
0812 00:00:36.735435 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.735480 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.736601 (+ 1121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.736889 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.736899 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.737559 (+ 660us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:36.758330 (+ 20771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.758347 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.759773 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.759775 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.761255 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.761260 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.761736 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.761736 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.761860 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.762408 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:36.762418 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:36.764460 (+ 2042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:36.766732 (+ 2272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.766745 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.766749 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.767005 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.767235 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.767236 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.767236 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.767353 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.767630 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:36.767639 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:36.768144 (+ 505us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.768977 (+ 833us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.769239 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"spinlock_wait_cycles":384,"thread_start_us":100,"threads_started":1}
I20260812 00:00:36.770130 5055 heartbeater.cc:347] Connected to a master server at 127.25.103.125:33621
I20260812 00:00:36.770237 5055 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:36.770603 5055 heartbeater.cc:511] Master 127.25.103.125:33621 requested a full tablet report, sending...
I20260812 00:00:36.771163 3330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.735682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:44805 (local address 127.25.103.126:42139)
0812 00:00:36.735732 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.735734 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.736859 (+ 1125us) server_negotiation.cc:407] Connection header received
0812 00:00:36.736964 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.736965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.736977 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.737036 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.762776 (+ 25740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.763548 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.764579 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.764860 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.764900 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.767990 (+ 3090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.767992 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.767993 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.768001 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.769888 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.770337 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.770338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.770338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.770401 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.770589 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.770589 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.770590 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.770724 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.770771 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.770969 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.771064 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:00:36.771332 4226 ts_manager.cc:194] Registered new tserver with Master: e5e971af558d438796045dda98dd4d76 (127.25.103.66:34837)
I20260812 00:00:36.771698 5058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.735572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.66:44805)
0812 00:00:36.736797 (+ 1225us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.736807 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.736885 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.737050 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.737051 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.737533 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:36.762652 (+ 25119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.762656 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.763663 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.763664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.764473 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.764476 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.765012 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.765013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.765083 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.765513 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:36.765519 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:36.767887 (+ 2368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:36.770016 (+ 2129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.770017 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.770018 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.770251 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.770469 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.770469 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.770469 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.770528 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.770806 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:36.770806 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:36.770856 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.771457 (+ 601us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.771584 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1205,"mutex_wait_us":2,"thread_start_us":61,"threads_started":1}
I20260812 00:00:36.772375 5051 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42139
I20260812 00:00:36.772416 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.735248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:55039 (local address 127.25.103.124:36953)
0812 00:00:36.735298 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.735300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.735762 (+ 462us) server_negotiation.cc:407] Connection header received
0812 00:00:36.736762 (+ 1000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.736763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.736781 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.736840 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.763537 (+ 26697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.764246 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.765233 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.765536 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.765583 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.768367 (+ 2784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.768370 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.768370 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.768392 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.770684 (+ 2292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.771294 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.771295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.771296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.771372 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.771735 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.771735 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.771736 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.771897 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.771966 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.772212 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.772317 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:00:36.772495 5060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.735264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36953 (local address 127.25.103.66:55039)
0812 00:00:36.735693 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.735704 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.736631 (+ 927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.736892 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.736898 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.737489 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:36.763413 (+ 25924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.763416 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.764353 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.764354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.765132 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.765135 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.765673 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.765674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.765740 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.766071 (+ 331us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:36.766076 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:36.768121 (+ 2045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:36.770832 (+ 2711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.770833 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.770834 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.771091 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.771447 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.771448 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.771448 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.771518 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.771997 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:36.771998 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:36.772047 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.772121 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.772269 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"mutex_wait_us":21,"thread_start_us":102,"threads_started":1}
I20260812 00:00:36.772557 5051 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:36.772675 5051 heartbeater.cc:511] Master 127.25.103.126:42139 requested a full tablet report, sending...
I20260812 00:00:36.773056 5053 heartbeater.cc:347] Connected to a master server at 127.25.103.124:36953
I20260812 00:00:36.773120 5053 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:36.773190 5053 heartbeater.cc:511] Master 127.25.103.124:36953 requested a full tablet report, sending...
I20260812 00:00:36.773307 3257 ts_manager.cc:194] Re-registered known tserver with Master: e5e971af558d438796045dda98dd4d76 (127.25.103.66:34837)
I20260812 00:00:36.773517 4541 ts_manager.cc:194] Registered new tserver with Master: e5e971af558d438796045dda98dd4d76 (127.25.103.66:34837)
I20260812 00:00:36.773871 3257 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:44805
W20260812 00:00:36.874809 5062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:36.875108 5062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:36.875139 5062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:36.877028 5062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:36.877103 5062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:36.877144 5062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:00:36.879065 5062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:36485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.67.keytab
--principal=oryx/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:45509
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=37227
--tserver_master_addrs=127.25.103.126:42139,127.25.103.125:33621,127.25.103.124:36953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:36.879369 5062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:36.879669 5062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:36.886397 5076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:36.886399 5073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:36.886705 5072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:36.886895 5062 server_base.cc:1034] running on GCE node
I20260812 00:00:36.887130 5062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:36.887398 5062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:36.888594 5062 hybrid_clock.cc:648] HybridClock initialized: now 1786492836888569 us; error 39 us; skew 500 ppm
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492836, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:36.891819 5062 init.cc:377] Logged in from keytab as oryx/127.25.103.67@KRBTEST.COM (short username oryx)
I20260812 00:00:36.892562 5062 webserver.cc:460] Webserver started at http://127.25.103.67:37227/ using document root <none> and password file <none>
I20260812 00:00:36.892879 5062 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:36.892966 5062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:36.894899 5062 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:00:36.895773 5093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:36.896051 5062 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:36.896150 5062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "1b4242e62e514c92b33c2d883d3c3e4a"
format_stamp: "Formatted at 2026-08-12 00:00:35 on dist-test-slave-vpvm"
server_key: "52bad4106402f346adde844342389e2f"
server_key_iv: "40ddcfd6e1c9c7c6226640dcc5c00454"
server_key_version: "encryptionkey@0"
I20260812 00:00:36.896569 5062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:36.918824 5062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:36.920154 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.916562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41430 (local address 127.25.103.124:36953)
0812 00:00:36.916667 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.916670 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.916723 (+ 53us) server_negotiation.cc:407] Connection header received
0812 00:00:36.916839 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.916840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.916869 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.916958 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:36.917177 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.918029 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.919138 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.919745 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.919838 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.919934 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.920026 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.920074 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 00:00:36.920157 5099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.916409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36953 (local address 127.0.0.1:41430)
0812 00:00:36.916626 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.916640 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.916745 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.916995 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.916996 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.917000 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:36.917090 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.917093 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.918164 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.918165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.919020 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.919023 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.919865 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.919866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.919943 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.919949 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.920005 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.920067 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":101,"threads_started":1}
I20260812 00:00:36.920751 4547 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260812 00:00:36.921018 5101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b7de6cdc99f40c68fa244af0853dac3. Latest consensus state: current_term: 1 leader_uuid: "2b7de6cdc99f40c68fa244af0853dac3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: NON_VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: true } } }
I20260812 00:00:36.921177 5101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [sys.catalog]: This master's current role is: LEARNER
I20260812 00:00:36.922238 5062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:36.922379 5062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:36.922601 5062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:36.922950 5062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:36.922992 5062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:36.923017 5062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:36.923028 5062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:36.931344 5062 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:45509
I20260812 00:00:36.931399 5263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:45509 every 8 connection(s)
I20260812 00:00:36.931924 5062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:00:36.937779 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 5062
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492836, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.125@KRBTEST.COM
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492836, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM
Aug 12 00:00:36 dist-test-slave-vpvm krb5kdc[3185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492836, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.124@KRBTEST.COM
I20260812 00:00:36.946914 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.932939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:59613 (local address 127.25.103.124:36953)
0812 00:00:36.932988 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.932990 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.933244 (+ 254us) server_negotiation.cc:407] Connection header received
0812 00:00:36.934503 (+ 1259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.934505 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.934525 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.934582 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.935489 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.936296 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.938101 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.938443 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.938494 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.943050 (+ 4556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.943053 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.943054 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.943064 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.944918 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.945547 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.945548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.945548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.945616 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.945921 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.945922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.945922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.946113 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.946176 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.946694 (+ 518us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.946793 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:00:36.946947 4313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.932928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:50337 (local address 127.25.103.125:33621)
0812 00:00:36.932985 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.932987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.933247 (+ 260us) server_negotiation.cc:407] Connection header received
0812 00:00:36.934650 (+ 1403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.934652 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.934663 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.934718 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.935541 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.936295 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.938098 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.938403 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.938461 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.943134 (+ 4673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.943136 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.943136 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.943147 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.944777 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.945536 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.945537 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.945538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.945600 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.945933 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.945934 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.945934 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.946111 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.946175 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.946684 (+ 509us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.946852 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:00:36.947067 5272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.933265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.67:39477)
0812 00:00:36.933403 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.933412 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.934385 (+ 973us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.934883 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.934884 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.935155 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:36.935398 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.935405 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.936363 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.936364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.938126 (+ 1762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.938129 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.938653 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.938653 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.938784 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.939626 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:36.939632 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:36.942549 (+ 2917us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:36.945174 (+ 2625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.945175 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.945176 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.945458 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.945666 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.945667 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.945667 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.945852 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.946204 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:36.946212 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:36.946444 (+ 232us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.946566 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.946794 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":193,"thread_start_us":81,"threads_started":1}
I20260812 00:00:36.947395 3330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.933458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:39477 (local address 127.25.103.126:42139)
0812 00:00:36.933521 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.933523 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.933533 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:00:36.934788 (+ 1255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.934789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.934800 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.934854 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.935519 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.936155 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.938227 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.938533 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.938573 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.942746 (+ 4173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.942748 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.942749 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.942757 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.945057 (+ 2300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.945536 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.945537 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.945538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.945600 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.945938 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.945938 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.945939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.946116 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.946175 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.947218 (+ 1043us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.947319 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:00:36.947850 5271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.932938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36953 (local address 127.25.103.67:59613)
0812 00:00:36.933142 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.933165 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.934392 (+ 1227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.934699 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.934704 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.935120 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:36.935398 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.935403 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.936723 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.936724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.937930 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.937935 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.938610 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.938611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.938784 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.939711 (+ 927us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:36.939715 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:36.942939 (+ 3224us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:36.945004 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.945006 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.945006 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.945453 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.945678 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.945679 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.945680 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.945853 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.946205 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:36.946213 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:36.946445 (+ 232us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.946567 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.947754 (+ 1187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":1115,"thread_start_us":122,"threads_started":1}
I20260812 00:00:36.948091 5265 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42139
I20260812 00:00:36.948211 5270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.932938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:33621 (local address 127.25.103.67:50337)
0812 00:00:36.933119 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.933165 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.934380 (+ 1215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.934762 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.934763 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.935143 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:36.935398 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.935405 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.936403 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.936404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.937938 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.937945 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.938579 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.938580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.938785 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.939511 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:36.939521 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:36.943000 (+ 3479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:36.944882 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.944897 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.944901 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.945445 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.945666 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:36.945667 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:36.945667 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:36.945855 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:36.946204 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:36.946212 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:36.946444 (+ 232us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.946566 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.948112 (+ 1546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":1144,"thread_start_us":97,"threads_started":1}
I20260812 00:00:36.948233 5265 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:36.948499 5265 heartbeater.cc:511] Master 127.25.103.126:42139 requested a full tablet report, sending...
I20260812 00:00:36.948714 5268 heartbeater.cc:347] Connected to a master server at 127.25.103.125:33621
I20260812 00:00:36.948778 5268 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:36.948866 5268 heartbeater.cc:511] Master 127.25.103.125:33621 requested a full tablet report, sending...
I20260812 00:00:36.948985 3257 ts_manager.cc:194] Re-registered known tserver with Master: 1b4242e62e514c92b33c2d883d3c3e4a (127.25.103.67:45509)
I20260812 00:00:36.949030 5266 heartbeater.cc:347] Connected to a master server at 127.25.103.124:36953
I20260812 00:00:36.949081 5266 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:36.949136 5266 heartbeater.cc:511] Master 127.25.103.124:36953 requested a full tablet report, sending...
I20260812 00:00:36.949285 4226 ts_manager.cc:194] Registered new tserver with Master: 1b4242e62e514c92b33c2d883d3c3e4a (127.25.103.67:45509)
I20260812 00:00:36.949496 3257 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:39477
I20260812 00:00:36.949548 4541 ts_manager.cc:194] Registered new tserver with Master: 1b4242e62e514c92b33c2d883d3c3e4a (127.25.103.67:45509)
I20260812 00:00:36.954497 5284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.941061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41440 (local address 127.25.103.124:36953)
0812 00:00:36.941415 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.941417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.941700 (+ 283us) server_negotiation.cc:407] Connection header received
0812 00:00:36.941814 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.941815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.941833 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.941924 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.942924 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.943657 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.948977 (+ 5320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.949633 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.949730 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.951571 (+ 1841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.951573 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.951573 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.951582 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.953014 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.953426 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.953427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.953428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.953494 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.953697 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.953698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.953698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.953855 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.954002 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.954281 (+ 279us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.954381 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":73,"threads_started":1}
I20260812 00:00:36.955832 5283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.941025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55610 (local address 127.25.103.126:42139)
0812 00:00:36.941995 (+ 970us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.941997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.942005 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:00:36.942030 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.942030 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.942044 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.942123 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.947146 (+ 5023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.948011 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.950770 (+ 2759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.951113 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.951197 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.952560 (+ 1363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.952562 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.952562 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.952569 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.954374 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.954987 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.954989 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.954989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.955054 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.955227 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.955228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.955228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.955350 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.955433 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.955578 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.955663 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":945,"thread_start_us":92,"threads_started":1}
I20260812 00:00:36.956054 5287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.941573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33284 (local address 127.25.103.125:33621)
0812 00:00:36.941803 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.941804 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.941864 (+ 60us) server_negotiation.cc:407] Connection header received
0812 00:00:36.941937 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.941937 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.944086 (+ 2149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.944345 (+ 259us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:36.948129 (+ 3784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.948872 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.951510 (+ 2638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.951828 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.951911 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.953141 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:36.953143 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:36.953143 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:36.953151 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:36.954876 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.955246 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.955247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.955247 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.955311 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:36.955539 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:36.955540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:36.955540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:36.955660 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:36.955739 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.955863 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.955958 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":75,"threads_started":1}
I20260812 00:00:36.957914 3257 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55610:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:00:36.960744 3257 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:00:36.962108 5294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2b7de6cdc99f40c68fa244af0853dac3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: NON_VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: true } } }
I20260812 00:00:36.962248 5294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:36.964023 5294 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3: attempting to promote NON_VOTER 9012954ccccb43edb9937277536b2461 to VOTER
I20260812 00:00:36.964221 5294 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false } }
I20260812 00:00:36.964630 4547 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 1 LEARNER]: Refusing update from remote peer 2b7de6cdc99f40c68fa244af0853dac3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 00:00:36.964968 4245 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 1 FOLLOWER]: Refusing update from remote peer 2b7de6cdc99f40c68fa244af0853dac3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 00:00:36.965075 4164 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 00:00:36.965478 5300 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 00:00:36.966341 5300 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 9012954ccccb43edb9937277536b2461 (127.25.103.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false } } }
I20260812 00:00:36.966506 4547 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 9012954ccccb43edb9937277536b2461 (127.25.103.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false } } }
I20260812 00:00:36.967499 5101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2b7de6cdc99f40c68fa244af0853dac3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false } } }
I20260812 00:00:36.967602 5101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:00:36.967801 4245 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 9012954ccccb43edb9937277536b2461 (127.25.103.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false } } }
I20260812 00:00:36.969005 5294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2b7de6cdc99f40c68fa244af0853dac3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false } } }
I20260812 00:00:36.969017 4164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2b7de6cdc99f40c68fa244af0853dac3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false } } }
I20260812 00:00:36.969128 5294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:36.969151 4164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:36.969264 5294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2b7de6cdc99f40c68fa244af0853dac3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false } } }
I20260812 00:00:36.969323 5294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:36.968873 5311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2b7de6cdc99f40c68fa244af0853dac3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false } } }
I20260812 00:00:36.969555 5311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:00:36.975502 5312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.970298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:45509 (local address 127.0.0.1:41772)
0812 00:00:36.970981 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.970991 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.971050 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.971199 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.971200 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.971202 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:36.971253 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.971255 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.972352 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.972353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.973311 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.973314 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.974986 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.974987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.975136 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.975144 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.975330 (+ 186us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.975390 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"mutex_wait_us":3,"thread_start_us":103,"threads_started":1}
I20260812 00:00:36.975736 5099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.970117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:45815 (local address 127.0.0.1:57226)
0812 00:00:36.970157 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.970171 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.970217 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.971012 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.971014 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.971018 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:36.971113 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.971116 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.972945 (+ 1829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.972947 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.973909 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.973913 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.975533 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.975538 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.975603 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.975607 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.975638 (+ 31us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.975692 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20,"mutex_wait_us":3}
I20260812 00:00:36.975896 5313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.970236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:34837 (local address 127.0.0.1:41454)
0812 00:00:36.970611 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:36.970621 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:36.970677 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:36.970853 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:36.970854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:36.970856 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:36.970924 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.970926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.972887 (+ 1961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.972888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.974011 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:36.974014 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.975641 (+ 1627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.975643 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:36.975723 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.975728 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:00:36.975776 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 00:00:36.975824 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":146,"threads_started":1}
I20260812 00:00:36.975566 5315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.970411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41772 (local address 127.25.103.67:45509)
0812 00:00:36.970606 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.970609 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.971051 (+ 442us) server_negotiation.cc:407] Connection header received
0812 00:00:36.971106 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.971108 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.971123 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.971192 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:36.971305 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.972275 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.973418 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.974739 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.974892 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.975018 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.975399 (+ 381us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.975464 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":115,"threads_started":1}
I20260812 00:00:36.976109 5316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.970468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57226 (local address 127.25.103.65:45815)
0812 00:00:36.970753 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.970757 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.970765 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:00:36.970802 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.970804 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.970818 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.970894 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:36.971270 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.972808 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.974066 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.975414 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.975849 (+ 435us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.975945 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.975973 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.976024 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":57,"threads_started":1}
I20260812 00:00:36.976235 5314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:36.970336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41454 (local address 127.25.103.66:34837)
0812 00:00:36.970506 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:36.970511 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:36.970690 (+ 179us) server_negotiation.cc:407] Connection header received
0812 00:00:36.970732 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:36.970734 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:36.970750 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:36.970834 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:36.971027 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.972747 (+ 1720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.974142 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:36.975159 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:36.975439 (+ 280us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:36.975605 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:36.976080 (+ 475us) server_negotiation.cc:299] Negotiation successful
0812 00:00:36.976153 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":93,"threads_started":1}
I20260812 00:00:36.976799 5165 tablet_service.cc:1467] Processing CreateTablet for tablet 2a92e3ac8cdd40199941b58041fed6c7 (DEFAULT_TABLE table=test-table [id=7ef0568187cf40f0973e825d838618ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:36.976922 4711 tablet_service.cc:1467] Processing CreateTablet for tablet 2a92e3ac8cdd40199941b58041fed6c7 (DEFAULT_TABLE table=test-table [id=7ef0568187cf40f0973e825d838618ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:36.977203 5165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a92e3ac8cdd40199941b58041fed6c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:36.977281 4711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a92e3ac8cdd40199941b58041fed6c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:36.978750 4939 tablet_service.cc:1467] Processing CreateTablet for tablet 2a92e3ac8cdd40199941b58041fed6c7 (DEFAULT_TABLE table=test-table [id=7ef0568187cf40f0973e825d838618ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:36.979272 4939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a92e3ac8cdd40199941b58041fed6c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:36.980885 5319 tablet_bootstrap.cc:492] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c: Bootstrap starting.
I20260812 00:00:36.981611 5319 tablet_bootstrap.cc:654] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:36.981863 5319 log.cc:824] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:36.982142 5320 tablet_bootstrap.cc:492] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a: Bootstrap starting.
I20260812 00:00:36.982681 5319 tablet_bootstrap.cc:492] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c: No bootstrap required, opened a new log
I20260812 00:00:36.982743 5319 ts_tablet_manager.cc:1397] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:36.982872 5320 tablet_bootstrap.cc:654] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:36.983223 5320 log.cc:824] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:36.984166 5320 tablet_bootstrap.cc:492] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a: No bootstrap required, opened a new log
I20260812 00:00:36.984297 5320 ts_tablet_manager.cc:1397] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:00:36.984680 5319 raft_consensus.cc:348] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } }
I20260812 00:00:36.984913 5319 raft_consensus.cc:374] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:36.984968 5319 raft_consensus.cc:729] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a1e56a83b4462fb704dfce8f64e27c, State: Initialized, Role: FOLLOWER
I20260812 00:00:36.985096 5319 consensus_queue.cc:260] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } }
I20260812 00:00:36.985397 5319 ts_tablet_manager.cc:1428] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:00:36.985522 4816 heartbeater.cc:503] Master 127.25.103.126:42139 was elected leader, sending a full tablet report...
I20260812 00:00:36.986171 5324 tablet_bootstrap.cc:492] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76: Bootstrap starting.
I20260812 00:00:36.986981 5324 tablet_bootstrap.cc:654] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:36.987061 5320 raft_consensus.cc:348] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } }
I20260812 00:00:36.987262 5320 raft_consensus.cc:374] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:36.987301 5320 raft_consensus.cc:729] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b4242e62e514c92b33c2d883d3c3e4a, State: Initialized, Role: FOLLOWER
I20260812 00:00:36.987329 5324 log.cc:824] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:36.987447 5320 consensus_queue.cc:260] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } }
I20260812 00:00:36.987886 5265 heartbeater.cc:503] Master 127.25.103.126:42139 was elected leader, sending a full tablet report...
I20260812 00:00:36.987828 5320 ts_tablet_manager.cc:1428] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260812 00:00:36.988637 5324 tablet_bootstrap.cc:492] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76: No bootstrap required, opened a new log
I20260812 00:00:36.988721 5324 ts_tablet_manager.cc:1397] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:00:36.991112 5324 raft_consensus.cc:348] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } }
I20260812 00:00:36.991286 5324 raft_consensus.cc:374] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:36.991312 5324 raft_consensus.cc:729] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e971af558d438796045dda98dd4d76, State: Initialized, Role: FOLLOWER
I20260812 00:00:36.991426 5324 consensus_queue.cc:260] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } }
I20260812 00:00:36.991753 5324 ts_tablet_manager.cc:1428] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:00:36.991796 5051 heartbeater.cc:503] Master 127.25.103.126:42139 was elected leader, sending a full tablet report...
I20260812 00:00:37.026695 5327 raft_consensus.cc:482] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:00:37.026895 5327 raft_consensus.cc:504] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } }
I20260812 00:00:37.027778 5327 leader_election.cc:288] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5e971af558d438796045dda98dd4d76 (127.25.103.66:34837), 1b4242e62e514c92b33c2d883d3c3e4a (127.25.103.67:45509)
I20260812 00:00:37.031610 5315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:37.028078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:53159 (local address 127.25.103.67:45509)
0812 00:00:37.028158 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:37.028160 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:37.028413 (+ 253us) server_negotiation.cc:407] Connection header received
0812 00:00:37.028451 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:37.028452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:37.028467 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:37.028557 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:37.028791 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:37.029493 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:37.030763 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:37.031216 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:37.031296 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:37.031306 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:37.031488 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 00:00:37.031536 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 00:00:37.031613 5332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:37.027923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:45509 (local address 127.25.103.65:53159)
0812 00:00:37.028237 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:37.028250 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:37.028331 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:37.028604 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:37.028606 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:37.028610 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:37.028705 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:37.028707 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:37.029644 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:37.029645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:37.030665 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:37.030669 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:37.031332 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:37.031334 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:37.031413 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:37.031417 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:00:37.031475 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 00:00:37.031512 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"mutex_wait_us":73,"thread_start_us":174,"threads_started":1}
I20260812 00:00:37.031890 4828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:37.027888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:34837 (local address 127.25.103.65:52281)
0812 00:00:37.027969 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:37.027981 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:37.028034 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:37.028371 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:37.028373 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:37.028376 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:37.028540 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:37.028543 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:37.029601 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:37.029602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:37.030949 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:37.030952 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:37.031656 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:37.031658 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:37.031727 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:37.031730 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:00:37.031787 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 00:00:37.031833 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":1}
I20260812 00:00:37.032056 5314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:37.028052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:52281 (local address 127.25.103.66:34837)
0812 00:00:37.028119 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:37.028122 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:37.028136 (+ 14us) server_negotiation.cc:407] Connection header received
0812 00:00:37.028178 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:37.028180 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:37.028193 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:37.028315 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:37.028648 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:37.029494 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:37.031062 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:37.031543 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:37.031617 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:37.031626 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:37.031880 (+ 254us) server_negotiation.cc:299] Negotiation successful
0812 00:00:37.031992 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 00:00:37.032125 5197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a92e3ac8cdd40199941b58041fed6c7" candidate_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" is_pre_election: true
I20260812 00:00:37.032299 5197 raft_consensus.cc:2454] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a1e56a83b4462fb704dfce8f64e27c in term 0.
I20260812 00:00:37.032341 4975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a92e3ac8cdd40199941b58041fed6c7" candidate_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e971af558d438796045dda98dd4d76" is_pre_election: true
I20260812 00:00:37.032487 4975 raft_consensus.cc:2454] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a1e56a83b4462fb704dfce8f64e27c in term 0.
I20260812 00:00:37.032544 4642 leader_election.cc:302] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b4242e62e514c92b33c2d883d3c3e4a, a6a1e56a83b4462fb704dfce8f64e27c; no voters:
I20260812 00:00:37.032670 5327 raft_consensus.cc:2781] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:00:37.032739 5327 raft_consensus.cc:482] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:00:37.032763 5327 raft_consensus.cc:3037] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:37.033571 5327 raft_consensus.cc:504] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } }
I20260812 00:00:37.033702 5327 leader_election.cc:288] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [CANDIDATE]: Term 1 election: Requested vote from peers e5e971af558d438796045dda98dd4d76 (127.25.103.66:34837), 1b4242e62e514c92b33c2d883d3c3e4a (127.25.103.67:45509)
I20260812 00:00:37.034070 4975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a92e3ac8cdd40199941b58041fed6c7" candidate_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e971af558d438796045dda98dd4d76"
I20260812 00:00:37.034060 5197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a92e3ac8cdd40199941b58041fed6c7" candidate_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b4242e62e514c92b33c2d883d3c3e4a"
I20260812 00:00:37.034152 4975 raft_consensus.cc:3037] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:37.034225 5197 raft_consensus.cc:3037] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:37.034966 4975 raft_consensus.cc:2454] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a1e56a83b4462fb704dfce8f64e27c in term 1.
I20260812 00:00:37.035184 4636 leader_election.cc:302] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6a1e56a83b4462fb704dfce8f64e27c, e5e971af558d438796045dda98dd4d76; no voters:
I20260812 00:00:37.035218 5197 raft_consensus.cc:2454] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a1e56a83b4462fb704dfce8f64e27c in term 1.
I20260812 00:00:37.035293 5327 raft_consensus.cc:2781] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:37.035513 5327 raft_consensus.cc:686] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [term 1 LEADER]: Becoming Leader. State: Replica: a6a1e56a83b4462fb704dfce8f64e27c, State: Running, Role: LEADER
I20260812 00:00:37.035629 5327 consensus_queue.cc:237] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } }
I20260812 00:00:37.036813 3256 catalog_manager.cc:5495] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a1e56a83b4462fb704dfce8f64e27c (127.25.103.65). New cstate: current_term: 1 leader_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } health_report { overall_health: UNKNOWN } } }
I20260812 00:00:37.054817 5316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:37.052078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57242 (local address 127.25.103.65:45815)
0812 00:00:37.052195 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:37.052197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:37.052205 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:00:37.052259 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:37.052260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:37.052287 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:37.052360 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:37.052519 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:37.053088 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:37.053888 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:37.054172 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:37.054237 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:37.054397 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:37.054546 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:37.054635 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:37.054665 (+ 30us) server_negotiation.cc:299] Negotiation successful
0812 00:00:37.054695 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 00:00:37.057418 4975 raft_consensus.cc:1261] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76 [term 1 FOLLOWER]: Refusing update from remote peer a6a1e56a83b4462fb704dfce8f64e27c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:37.057482 5197 raft_consensus.cc:1261] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a [term 1 FOLLOWER]: Refusing update from remote peer a6a1e56a83b4462fb704dfce8f64e27c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:37.057904 5327 consensus_queue.cc:1035] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:37.058138 5333 consensus_queue.cc:1035] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:37.061331 5344 mvcc.cc:205] Tried to move back new op lower bound from 7317474660582559744 to 7317474660498726912. Current Snapshot: MvccSnapshot[applied={T|T < 7317474660582559744}]
I20260812 00:00:37.063194 5345 mvcc.cc:205] Tried to move back new op lower bound from 7317474660582559744 to 7317474660498726912. Current Snapshot: MvccSnapshot[applied={T|T < 7317474660582559744}]
I20260812 00:00:37.065943 3256 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55610:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:37.066118 3256 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55610:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:37.067919 3256 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b7de6cdc99f40c68fa244af0853dac3: Sending DeleteTablet for 3 replicas of tablet 2a92e3ac8cdd40199941b58041fed6c7
I20260812 00:00:37.068380 4711 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a92e3ac8cdd40199941b58041fed6c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:37 UTC) from {username='oryx', principal='oryx/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:57226
I20260812 00:00:37.068415 5165 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a92e3ac8cdd40199941b58041fed6c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:37 UTC) from {username='oryx', principal='oryx/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:41772
I20260812 00:00:37.068446 4939 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a92e3ac8cdd40199941b58041fed6c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:37 UTC) from {username='oryx', principal='oryx/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:41454
I20260812 00:00:37.068728 5361 tablet_replica.cc:330] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a: stopping tablet replica
I20260812 00:00:37.068728 5357 tablet_replica.cc:330] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c: stopping tablet replica
I20260812 00:00:37.068845 5361 raft_consensus.cc:2229] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:37.068845 5357 raft_consensus.cc:2229] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:00:37.068964 5357 raft_consensus.cc:2258] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:37.068974 5361 raft_consensus.cc:2258] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:37.069548 5361 ts_tablet_manager.cc:1905] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:37.069684 5357 ts_tablet_manager.cc:1905] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:37.070612 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 3201
I20260812 00:00:37.084646 5361 ts_tablet_manager.cc:1918] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:00:37.084812 5361 log.cc:1196] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/2a92e3ac8cdd40199941b58041fed6c7
I20260812 00:00:37.085093 5357 ts_tablet_manager.cc:1918] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:00:37.085170 5361 ts_tablet_manager.cc:1939] T 2a92e3ac8cdd40199941b58041fed6c7 P 1b4242e62e514c92b33c2d883d3c3e4a: Deleting consensus metadata
I20260812 00:00:37.085180 5357 log.cc:1196] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-0/wal/wals/2a92e3ac8cdd40199941b58041fed6c7
I20260812 00:00:37.085448 5357 ts_tablet_manager.cc:1939] T 2a92e3ac8cdd40199941b58041fed6c7 P a6a1e56a83b4462fb704dfce8f64e27c: Deleting consensus metadata
I20260812 00:00:37.090611 5358 tablet_replica.cc:330] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76: stopping tablet replica
I20260812 00:00:37.090817 5358 raft_consensus.cc:2229] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:37.090965 5358 raft_consensus.cc:2258] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:37.091646 5358 ts_tablet_manager.cc:1905] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:37.093552 5358 ts_tablet_manager.cc:1918] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:00:37.093668 5358 log.cc:1196] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/2a92e3ac8cdd40199941b58041fed6c7
I20260812 00:00:37.094013 5358 ts_tablet_manager.cc:1939] T 2a92e3ac8cdd40199941b58041fed6c7 P e5e971af558d438796045dda98dd4d76: Deleting consensus metadata
W20260812 00:00:37.096758 4859 connection.cc:535] server connection from 127.0.0.1:41454 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 00:00:37.096783 4641 connection.cc:535] server connection from 127.0.0.1:57226 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 00:00:37.096982 5094 connection.cc:535] server connection from 127.0.0.1:41772 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:00:37.100279 5284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:37.069899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41456 (local address 127.25.103.124:36953)
0812 00:00:37.069979 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:37.069981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:37.090447 (+ 20466us) server_negotiation.cc:407] Connection header received
0812 00:00:37.090533 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:37.090536 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:37.090584 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:37.090710 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:37.092211 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:37.093036 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:37.094151 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:37.094507 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:37.094561 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:37.096335 (+ 1774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:37.096338 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:37.096338 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:37.096348 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:37.098737 (+ 2389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:37.099212 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:37.099213 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:37.099214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:37.099279 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:37.099525 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:37.099526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:37.099526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:37.099682 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:37.099765 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:37.100058 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 00:00:37.100182 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:00:37.108449 5287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:37.099805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33286 (local address 127.25.103.125:33621)
0812 00:00:37.099879 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:37.099882 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:37.100089 (+ 207us) server_negotiation.cc:407] Connection header received
0812 00:00:37.100206 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:37.100208 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:37.100227 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:37.100259 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:37.101608 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:37.102414 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:37.103295 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:37.103522 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:37.103583 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:37.105086 (+ 1503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:37.105088 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:37.105089 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:37.105098 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:37.106630 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:37.107081 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:37.107082 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:37.107083 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:37.107152 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:37.107409 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:37.107411 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:37.107411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:37.107605 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:37.107710 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:37.108193 (+ 483us) server_negotiation.cc:299] Negotiation successful
0812 00:00:37.108337 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:00:37.109210 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:37.099525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41462 (local address 127.25.103.124:36953)
0812 00:00:37.099575 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:37.099577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:37.099736 (+ 159us) server_negotiation.cc:407] Connection header received
0812 00:00:37.099907 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:37.099909 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:37.099926 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:37.099995 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:37.101779 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:37.102576 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:37.104104 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:37.104387 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:37.104476 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:37.106656 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:37.106657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:37.106658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:37.106667 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:37.108091 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:37.108476 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:37.108477 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:37.108477 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:37.108530 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:37.108706 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:37.108706 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:37.108707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:37.108825 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:37.108921 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:37.109030 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 00:00:37.109117 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:00:38.063778 5373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.063248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.66:47511)
0812 00:00:38.063555 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.063698 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":121,"threads_started":1}
W20260812 00:00:38.064098 5051 heartbeater.cc:644] Failed to heartbeat to 127.25.103.126:42139 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
I20260812 00:00:38.064203 5374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.063865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.65:33379)
0812 00:00:38.064055 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.064153 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":85,"threads_started":1}
W20260812 00:00:38.064507 4816 heartbeater.cc:644] Failed to heartbeat to 127.25.103.126:42139 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
I20260812 00:00:38.067044 5375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.066752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.67:57073)
0812 00:00:38.066908 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.066997 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":79,"threads_started":1}
W20260812 00:00:38.067294 5265 heartbeater.cc:644] Failed to heartbeat to 127.25.103.126:42139 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
I20260812 00:00:38.568637 5377 raft_consensus.cc:482] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b7de6cdc99f40c68fa244af0853dac3)
I20260812 00:00:38.568822 5377 raft_consensus.cc:504] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false } }
I20260812 00:00:38.569118 5377 leader_election.cc:288] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b7de6cdc99f40c68fa244af0853dac3 (127.25.103.126:42139), 9012954ccccb43edb9937277536b2461 (127.25.103.124:36953)
I20260812 00:00:38.569500 5379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.569255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.0.0.1:56076)
0812 00:00:38.569372 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.569453 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":55,"threads_started":1}
W20260812 00:00:38.569639 4201 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
I20260812 00:00:38.570047 5379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.569933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.0.0.1:56082)
0812 00:00:38.569996 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.570027 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 00:00:38.570143 4201 leader_election.cc:334] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2b7de6cdc99f40c68fa244af0853dac3 (127.25.103.126:42139): Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
I20260812 00:00:38.570824 5385 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b7de6cdc99f40c68fa244af0853dac3)
I20260812 00:00:38.570946 5385 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false } }
I20260812 00:00:38.571216 5385 leader_election.cc:288] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b7de6cdc99f40c68fa244af0853dac3 (127.25.103.126:42139), 482b3ae12a0c41dba76f5a3cb648737b (127.25.103.125:33621)
I20260812 00:00:38.571761 5386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.571502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.0.0.1:56098)
0812 00:00:38.571668 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.571725 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":102,"threads_started":1}
W20260812 00:00:38.572034 4526 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
I20260812 00:00:38.572767 5387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.572630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.0.0.1:56114)
0812 00:00:38.572680 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.572732 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260812 00:00:38.572880 5380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.569431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41466 (local address 127.25.103.124:36953)
0812 00:00:38.569548 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:38.569550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:38.569560 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:00:38.569594 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:38.569594 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:38.569607 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:38.569687 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:38.570007 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.570600 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.571889 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.572495 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.572567 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:38.572578 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:38.572755 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 00:00:38.572807 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":56,"threads_started":1}
W20260812 00:00:38.572930 4526 leader_election.cc:334] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2b7de6cdc99f40c68fa244af0853dac3 (127.25.103.126:42139): Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
I20260812 00:00:38.573096 5378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.569267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36953 (local address 127.0.0.1:41466)
0812 00:00:38.569372 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.569383 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:38.569442 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:38.569749 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:38.569751 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:38.569753 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:38.569816 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:38.569818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.570689 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.570691 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:38.571769 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:38.571773 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.572612 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.572613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:38.572678 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:38.572683 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:00:38.572974 (+ 291us) client_negotiation.cc:240] Negotiation successful
0812 00:00:38.573025 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":44,"threads_started":1}
I20260812 00:00:38.573406 4547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "482b3ae12a0c41dba76f5a3cb648737b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "9012954ccccb43edb9937277536b2461" is_pre_election: true
I20260812 00:00:38.573553 4547 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482b3ae12a0c41dba76f5a3cb648737b in term 1.
I20260812 00:00:38.573755 4199 leader_election.cc:302] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482b3ae12a0c41dba76f5a3cb648737b, 9012954ccccb43edb9937277536b2461; no voters: 2b7de6cdc99f40c68fa244af0853dac3
I20260812 00:00:38.573920 5377 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 00:00:38.573998 5377 raft_consensus.cc:482] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b7de6cdc99f40c68fa244af0853dac3)
I20260812 00:00:38.574019 5377 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:00:38.574918 5377 raft_consensus.cc:504] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false } }
I20260812 00:00:38.575104 5377 leader_election.cc:288] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [CANDIDATE]: Term 2 election: Requested vote from peers 2b7de6cdc99f40c68fa244af0853dac3 (127.25.103.126:42139), 9012954ccccb43edb9937277536b2461 (127.25.103.124:36953)
I20260812 00:00:38.575289 5386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.571724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:33621 (local address 127.0.0.1:33300)
0812 00:00:38.571827 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.571838 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:38.571890 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:38.572302 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:38.572302 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:38.572305 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:38.572346 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:38.572348 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.573249 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.573250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:38.574337 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:38.574340 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.574987 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.574989 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:38.575057 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:38.575063 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:00:38.575152 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 00:00:38.575200 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":172,"threads_started":1}
I20260812 00:00:38.575481 5378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.575278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.0.0.1:56120)
0812 00:00:38.575403 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.575432 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260812 00:00:38.575546 5388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.571916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33300 (local address 127.25.103.125:33621)
0812 00:00:38.572165 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:38.572168 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:38.572175 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:00:38.572193 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:38.572194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:38.572204 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:38.572400 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:38.572428 (+ 28us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.573142 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.574497 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.574888 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.574956 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:38.574964 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:38.575389 (+ 425us) server_negotiation.cc:299] Negotiation successful
0812 00:00:38.575442 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":159,"threads_started":1}
I20260812 00:00:38.575497 4547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "482b3ae12a0c41dba76f5a3cb648737b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "9012954ccccb43edb9937277536b2461"
I20260812 00:00:38.575596 4547 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:00:38.575704 4245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9012954ccccb43edb9937277536b2461" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "482b3ae12a0c41dba76f5a3cb648737b" is_pre_election: true
I20260812 00:00:38.575769 5378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.575701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.0.0.1:56132)
0812 00:00:38.575727 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.575750 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
I20260812 00:00:38.575809 4245 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9012954ccccb43edb9937277536b2461 in current term 2: Already voted for candidate 482b3ae12a0c41dba76f5a3cb648737b in this term.
W20260812 00:00:38.575834 4201 leader_election.cc:334] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2b7de6cdc99f40c68fa244af0853dac3 (127.25.103.126:42139): Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
I20260812 00:00:38.576012 4526 leader_election.cc:302] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9012954ccccb43edb9937277536b2461; no voters: 2b7de6cdc99f40c68fa244af0853dac3, 482b3ae12a0c41dba76f5a3cb648737b
I20260812 00:00:38.576529 4547 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482b3ae12a0c41dba76f5a3cb648737b in term 2.
I20260812 00:00:38.576668 5385 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:00:38.576887 4199 leader_election.cc:302] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482b3ae12a0c41dba76f5a3cb648737b, 9012954ccccb43edb9937277536b2461; no voters: 2b7de6cdc99f40c68fa244af0853dac3
I20260812 00:00:38.577013 5377 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:00:38.577263 5377 raft_consensus.cc:686] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [term 2 LEADER]: Becoming Leader. State: Replica: 482b3ae12a0c41dba76f5a3cb648737b, State: Running, Role: LEADER
I20260812 00:00:38.577363 5377 consensus_queue.cc:237] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false } }
I20260812 00:00:38.577806 5392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 482b3ae12a0c41dba76f5a3cb648737b. Latest consensus state: current_term: 2 leader_uuid: "482b3ae12a0c41dba76f5a3cb648737b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false } } }
I20260812 00:00:38.577894 5392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:38.578171 5395 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:38.578696 5395 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:00:38.578778 5395 catalog_manager.cc:1259] Loaded cluster ID: 5ff4f1421ff24408b02670b76d6ca405
I20260812 00:00:38.578922 5395 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:00:38.579133 5395 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:38.579200 5395 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: Loaded TSK: 0
I20260812 00:00:38.579454 5395 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:00:38.609330 4226 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33286:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:00:38.611238 4226 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:00:38.612488 5378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.612376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.0.0.1:56142)
0812 00:00:38.612425 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.612458 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 00:00:38.612542 4547 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [term 2 FOLLOWER]: Refusing update from remote peer 482b3ae12a0c41dba76f5a3cb648737b: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260812 00:00:38.612820 5377 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260812 00:00:38.612895 5378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.612814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.0.0.1:56152)
0812 00:00:38.612847 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.612873 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260812 00:00:38.612995 4201 consensus_peers.cc:487] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b -> Peer 2b7de6cdc99f40c68fa244af0853dac3 (127.25.103.126:42139): Couldn't send request to peer 2b7de6cdc99f40c68fa244af0853dac3. Status: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 00:00:38.613487 5385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 482b3ae12a0c41dba76f5a3cb648737b. Latest consensus state: current_term: 2 leader_uuid: "482b3ae12a0c41dba76f5a3cb648737b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false } } }
I20260812 00:00:38.613587 5385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:00:38.614055 5377 sys_catalog.cc:455] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "482b3ae12a0c41dba76f5a3cb648737b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false } } }
I20260812 00:00:38.614148 5377 sys_catalog.cc:458] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:38.614214 5385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "482b3ae12a0c41dba76f5a3cb648737b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2b7de6cdc99f40c68fa244af0853dac3" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42139 } } peers { permanent_uuid: "482b3ae12a0c41dba76f5a3cb648737b" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 33621 } attrs { promote: false } } peers { permanent_uuid: "9012954ccccb43edb9937277536b2461" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36953 } attrs { promote: false } } }
I20260812 00:00:38.614313 5385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9012954ccccb43edb9937277536b2461 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:00:38.620258 5405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.616476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57250 (local address 127.25.103.65:45815)
0812 00:00:38.616672 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:38.616674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:38.616683 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:38.616710 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:38.616711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:38.616722 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:38.616956 (+ 234us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:38.616996 (+ 40us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.617634 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.619326 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.619838 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.619923 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:38.619944 (+ 21us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:38.620094 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 00:00:38.620152 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":59,"threads_started":1}
I20260812 00:00:38.620258 5379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.616312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:45815 (local address 127.0.0.1:57250)
0812 00:00:38.616444 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.616453 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:38.616495 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:38.616821 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:38.616822 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:38.616827 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:38.616893 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:38.616895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.617924 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.617926 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:38.619121 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:38.619125 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.619939 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.619940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:38.620026 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:38.620030 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:00:38.620081 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:00:38.620152 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":22}
I20260812 00:00:38.620515 5406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.616452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:45509 (local address 127.0.0.1:41786)
0812 00:00:38.616712 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.616720 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:38.616761 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:38.616918 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:38.616919 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:38.616920 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:38.616952 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:38.616953 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.617835 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.617836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:38.619243 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:38.619244 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.620227 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.620227 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:38.620283 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:38.620292 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 00:00:38.620336 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:00:38.620385 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":64,"thread_start_us":93,"threads_started":1}
I20260812 00:00:38.620515 5378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.616312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:34837 (local address 127.0.0.1:41468)
0812 00:00:38.616378 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.616391 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:38.616430 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:38.616851 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:38.616852 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:38.616853 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:38.616898 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:38.616900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.617839 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.617839 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:38.619239 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:38.619243 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.620206 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.620207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:38.620283 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:38.620293 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 00:00:38.620322 (+ 29us) client_negotiation.cc:240] Negotiation successful
0812 00:00:38.620397 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":156}
I20260812 00:00:38.620671 4711 tablet_service.cc:1467] Processing CreateTablet for tablet b04e606670fd40f7b4ee5b86aac69d56 (DEFAULT_TABLE table=test-table [id=608334a74f824cd4bb87d3d93abe5089]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:38.620843 5410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.616580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41468 (local address 127.25.103.66:34837)
0812 00:00:38.616694 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:38.616696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:38.616704 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:00:38.616731 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:38.616732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:38.616743 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:38.616848 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:38.616946 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.617739 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.619344 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.620088 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.620544 (+ 456us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:38.620558 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:38.620611 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 00:00:38.620772 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":61,"threads_started":1}
I20260812 00:00:38.620872 5414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.616647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41786 (local address 127.25.103.67:45509)
0812 00:00:38.616763 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:38.616764 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:38.616772 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:00:38.616801 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:38.616802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:38.616812 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:38.616864 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:38.617011 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.617739 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.619346 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.620088 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.620176 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:38.620193 (+ 17us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:38.620748 (+ 555us) server_negotiation.cc:299] Negotiation successful
0812 00:00:38.620797 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":64,"threads_started":1}
I20260812 00:00:38.620931 4711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b04e606670fd40f7b4ee5b86aac69d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:38.621058 4939 tablet_service.cc:1467] Processing CreateTablet for tablet b04e606670fd40f7b4ee5b86aac69d56 (DEFAULT_TABLE table=test-table [id=608334a74f824cd4bb87d3d93abe5089]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:38.621225 4939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b04e606670fd40f7b4ee5b86aac69d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:38.622545 5415 tablet_bootstrap.cc:492] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76: Bootstrap starting.
I20260812 00:00:38.622592 5165 tablet_service.cc:1467] Processing CreateTablet for tablet b04e606670fd40f7b4ee5b86aac69d56 (DEFAULT_TABLE table=test-table [id=608334a74f824cd4bb87d3d93abe5089]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:38.622584 5416 tablet_bootstrap.cc:492] T b04e606670fd40f7b4ee5b86aac69d56 P a6a1e56a83b4462fb704dfce8f64e27c: Bootstrap starting.
I20260812 00:00:38.622723 5165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b04e606670fd40f7b4ee5b86aac69d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:38.623183 5416 tablet_bootstrap.cc:654] T b04e606670fd40f7b4ee5b86aac69d56 P a6a1e56a83b4462fb704dfce8f64e27c: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:38.623199 5415 tablet_bootstrap.cc:654] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:38.623991 5416 tablet_bootstrap.cc:492] T b04e606670fd40f7b4ee5b86aac69d56 P a6a1e56a83b4462fb704dfce8f64e27c: No bootstrap required, opened a new log
I20260812 00:00:38.624024 5415 tablet_bootstrap.cc:492] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76: No bootstrap required, opened a new log
I20260812 00:00:38.624081 5416 ts_tablet_manager.cc:1397] T b04e606670fd40f7b4ee5b86aac69d56 P a6a1e56a83b4462fb704dfce8f64e27c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:38.624082 5415 ts_tablet_manager.cc:1397] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:38.624264 5416 raft_consensus.cc:348] T b04e606670fd40f7b4ee5b86aac69d56 P a6a1e56a83b4462fb704dfce8f64e27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } }
I20260812 00:00:38.624297 5415 raft_consensus.cc:348] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } }
I20260812 00:00:38.624361 5416 raft_consensus.cc:374] T b04e606670fd40f7b4ee5b86aac69d56 P a6a1e56a83b4462fb704dfce8f64e27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:38.624379 5415 raft_consensus.cc:374] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:38.624387 5416 raft_consensus.cc:729] T b04e606670fd40f7b4ee5b86aac69d56 P a6a1e56a83b4462fb704dfce8f64e27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a1e56a83b4462fb704dfce8f64e27c, State: Initialized, Role: FOLLOWER
I20260812 00:00:38.624404 5415 raft_consensus.cc:729] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e971af558d438796045dda98dd4d76, State: Initialized, Role: FOLLOWER
I20260812 00:00:38.624464 5415 consensus_queue.cc:260] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } }
I20260812 00:00:38.624527 5416 consensus_queue.cc:260] T b04e606670fd40f7b4ee5b86aac69d56 P a6a1e56a83b4462fb704dfce8f64e27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } }
I20260812 00:00:38.624653 5415 ts_tablet_manager.cc:1428] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:38.624812 5416 ts_tablet_manager.cc:1428] T b04e606670fd40f7b4ee5b86aac69d56 P a6a1e56a83b4462fb704dfce8f64e27c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:38.624866 5422 tablet_bootstrap.cc:492] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a: Bootstrap starting.
I20260812 00:00:38.625352 5422 tablet_bootstrap.cc:654] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:38.625576 5425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.625127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.66:50625)
0812 00:00:38.625311 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.625451 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":106,"threads_started":1}
I20260812 00:00:38.626050 5428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.625587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.65:45037)
0812 00:00:38.625944 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.626010 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":91,"threads_started":1}
I20260812 00:00:38.626665 5422 tablet_bootstrap.cc:492] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a: No bootstrap required, opened a new log
I20260812 00:00:38.626694 5055 heartbeater.cc:503] Master 127.25.103.125:33621 was elected leader, sending a full tablet report...
I20260812 00:00:38.626747 5422 ts_tablet_manager.cc:1397] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:38.626756 5425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.626608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.66:35481)
0812 00:00:38.626696 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.626731 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 00:00:38.626748 5428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.626643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.65:52753)
0812 00:00:38.626695 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.626721 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 00:00:38.626935 4818 heartbeater.cc:503] Master 127.25.103.125:33621 was elected leader, sending a full tablet report...
I20260812 00:00:38.626915 5422 raft_consensus.cc:348] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } }
I20260812 00:00:38.627270 5422 raft_consensus.cc:374] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:38.627302 5422 raft_consensus.cc:729] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b4242e62e514c92b33c2d883d3c3e4a, State: Initialized, Role: FOLLOWER
I20260812 00:00:38.627357 5422 consensus_queue.cc:260] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } }
I20260812 00:00:38.627525 5422 ts_tablet_manager.cc:1428] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 00:00:38.628175 5431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.627866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.67:51373)
0812 00:00:38.628078 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.628122 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":137,"threads_started":1}
I20260812 00:00:38.628770 5431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.628483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.67:56247)
0812 00:00:38.628588 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.628642 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 00:00:38.633610 5430 raft_consensus.cc:482] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:00:38.633733 5430 raft_consensus.cc:504] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } }
I20260812 00:00:38.634183 5430 leader_election.cc:288] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a1e56a83b4462fb704dfce8f64e27c (127.25.103.65:45815), e5e971af558d438796045dda98dd4d76 (127.25.103.66:34837)
I20260812 00:00:38.636922 5410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.634405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:45323 (local address 127.25.103.66:34837)
0812 00:00:38.634454 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:38.634456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:38.634613 (+ 157us) server_negotiation.cc:407] Connection header received
0812 00:00:38.634666 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:38.634667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:38.634676 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:38.634728 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:38.634851 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.635332 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.636227 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.636596 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.636658 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:38.636669 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:38.636804 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 00:00:38.636843 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:00:38.636936 5405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.634450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:60103 (local address 127.25.103.65:45815)
0812 00:00:38.634495 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:38.634497 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:38.634504 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:00:38.634530 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:38.634531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:38.634549 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:38.634592 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:38.634743 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.635246 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.636217 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.636604 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.636664 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:38.636676 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:38.636828 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 00:00:38.636869 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:00:38.636936 5431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.634324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:45815 (local address 127.25.103.67:60103)
0812 00:00:38.634363 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.634377 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:38.634432 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:38.634606 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:38.634607 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:38.634610 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:38.634687 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:38.634688 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.635326 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.635327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:38.636126 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:38.636129 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.636698 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.636700 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:38.636768 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:38.636771 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:00:38.636815 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:00:38.636858 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260812 00:00:38.636945 5432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.634341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:34837 (local address 127.25.103.67:45323)
0812 00:00:38.634551 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.634560 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:38.634614 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:38.634734 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:38.634735 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:38.634736 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:38.634799 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:38.634800 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.635406 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.635407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:38.636145 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:38.636147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.636667 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.636667 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:38.636742 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:38.636748 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:00:38.636793 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 00:00:38.636843 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":122,"threads_started":1}
I20260812 00:00:38.637252 4975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b04e606670fd40f7b4ee5b86aac69d56" candidate_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e971af558d438796045dda98dd4d76" is_pre_election: true
I20260812 00:00:38.637219 4745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b04e606670fd40f7b4ee5b86aac69d56" candidate_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" is_pre_election: true
I20260812 00:00:38.637354 4975 raft_consensus.cc:2454] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b4242e62e514c92b33c2d883d3c3e4a in term 0.
I20260812 00:00:38.637369 4745 raft_consensus.cc:2454] T b04e606670fd40f7b4ee5b86aac69d56 P a6a1e56a83b4462fb704dfce8f64e27c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b4242e62e514c92b33c2d883d3c3e4a in term 0.
I20260812 00:00:38.637526 5094 leader_election.cc:302] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b4242e62e514c92b33c2d883d3c3e4a, e5e971af558d438796045dda98dd4d76; no voters:
I20260812 00:00:38.637665 5430 raft_consensus.cc:2781] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:00:38.637707 5430 raft_consensus.cc:482] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:00:38.637725 5430 raft_consensus.cc:3037] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:38.638517 5430 raft_consensus.cc:504] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } }
I20260812 00:00:38.638662 5430 leader_election.cc:288] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [CANDIDATE]: Term 1 election: Requested vote from peers a6a1e56a83b4462fb704dfce8f64e27c (127.25.103.65:45815), e5e971af558d438796045dda98dd4d76 (127.25.103.66:34837)
I20260812 00:00:38.638986 4745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b04e606670fd40f7b4ee5b86aac69d56" candidate_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a1e56a83b4462fb704dfce8f64e27c"
I20260812 00:00:38.638963 4975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b04e606670fd40f7b4ee5b86aac69d56" candidate_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e971af558d438796045dda98dd4d76"
I20260812 00:00:38.639094 4745 raft_consensus.cc:3037] T b04e606670fd40f7b4ee5b86aac69d56 P a6a1e56a83b4462fb704dfce8f64e27c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:38.639111 4975 raft_consensus.cc:3037] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:38.640075 4975 raft_consensus.cc:2454] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b4242e62e514c92b33c2d883d3c3e4a in term 1.
I20260812 00:00:38.640105 4745 raft_consensus.cc:2454] T b04e606670fd40f7b4ee5b86aac69d56 P a6a1e56a83b4462fb704dfce8f64e27c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b4242e62e514c92b33c2d883d3c3e4a in term 1.
I20260812 00:00:38.640314 5094 leader_election.cc:302] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b4242e62e514c92b33c2d883d3c3e4a, e5e971af558d438796045dda98dd4d76; no voters:
I20260812 00:00:38.640458 5430 raft_consensus.cc:2781] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:38.640694 5430 raft_consensus.cc:686] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [term 1 LEADER]: Becoming Leader. State: Replica: 1b4242e62e514c92b33c2d883d3c3e4a, State: Running, Role: LEADER
I20260812 00:00:38.640807 5268 heartbeater.cc:503] Master 127.25.103.125:33621 was elected leader, sending a full tablet report...
I20260812 00:00:38.640901 5430 consensus_queue.cc:237] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } }
I20260812 00:00:38.641124 5432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.640987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.67:51147)
0812 00:00:38.641049 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.641086 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 00:00:38.642076 4226 catalog_manager.cc:5495] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b4242e62e514c92b33c2d883d3c3e4a (127.25.103.67). New cstate: current_term: 1 leader_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b4242e62e514c92b33c2d883d3c3e4a" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 45509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 } health_report { overall_health: UNKNOWN } } }
I20260812 00:00:38.652009 5414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.648838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41794 (local address 127.25.103.67:45509)
0812 00:00:38.648899 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:38.648901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:38.648911 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:00:38.648953 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:38.648954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:38.648977 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:38.649051 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:38.649278 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.649836 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.650808 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:38.651017 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:38.651099 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:38.651518 (+ 419us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:38.651663 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:38.651743 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:38.651899 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 00:00:38.651934 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:00:38.653391 4975 raft_consensus.cc:1261] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76 [term 1 FOLLOWER]: Refusing update from remote peer 1b4242e62e514c92b33c2d883d3c3e4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:38.653469 4745 raft_consensus.cc:1261] T b04e606670fd40f7b4ee5b86aac69d56 P a6a1e56a83b4462fb704dfce8f64e27c [term 1 FOLLOWER]: Refusing update from remote peer 1b4242e62e514c92b33c2d883d3c3e4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:38.653728 5434 consensus_queue.cc:1035] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e971af558d438796045dda98dd4d76" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:38.653892 5430 consensus_queue.cc:1035] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a1e56a83b4462fb704dfce8f64e27c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:38.655073 5425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.654864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.66:43441)
0812 00:00:38.654999 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.655036 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260812 00:00:38.655905 5432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.655731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.67:34355)
0812 00:00:38.655839 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.655873 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260812 00:00:38.656248 5428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.654622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.65:43781)
0812 00:00:38.656178 (+ 1556us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.656212 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1533}
I20260812 00:00:38.656625 5440 mvcc.cc:205] Tried to move back new op lower bound from 7317474667121737728 to 7317474667073953792. Current Snapshot: MvccSnapshot[applied={T|T < 7317474667121737728}]
I20260812 00:00:38.656716 5428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.656615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.65:54117)
0812 00:00:38.656659 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.656691 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 00:00:38.657823 5432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.657679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.67:46685)
0812 00:00:38.657729 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.657787 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 00:00:38.658147 5425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.657997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42139 (local address 127.25.103.66:51155)
0812 00:00:38.658083 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.658110 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260812 00:00:38.660383 4226 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:38.660501 4226 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:38.662576 4226 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 482b3ae12a0c41dba76f5a3cb648737b: Sending DeleteTablet for 3 replicas of tablet b04e606670fd40f7b4ee5b86aac69d56
I20260812 00:00:38.663014 4939 tablet_service.cc:1514] Processing DeleteTablet for tablet b04e606670fd40f7b4ee5b86aac69d56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:38 UTC) from {username='oryx', principal='oryx/127.25.103.125@KRBTEST.COM'} at 127.0.0.1:41468
I20260812 00:00:38.663084 5165 tablet_service.cc:1514] Processing DeleteTablet for tablet b04e606670fd40f7b4ee5b86aac69d56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:38 UTC) from {username='oryx', principal='oryx/127.25.103.125@KRBTEST.COM'} at 127.0.0.1:41786
I20260812 00:00:38.663478 4711 tablet_service.cc:1514] Processing DeleteTablet for tablet b04e606670fd40f7b4ee5b86aac69d56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:38 UTC) from {username='oryx', principal='oryx/127.25.103.125@KRBTEST.COM'} at 127.0.0.1:57250
I20260812 00:00:38.663781 5463 tablet_replica.cc:330] T b04e606670fd40f7b4ee5b86aac69d56 P a6a1e56a83b4462fb704dfce8f64e27c: stopping tablet replica
I20260812 00:00:38.663827 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 4485
I20260812 00:00:38.663873 5463 raft_consensus.cc:2229] T b04e606670fd40f7b4ee5b86aac69d56 P a6a1e56a83b4462fb704dfce8f64e27c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:38.663939 5463 raft_consensus.cc:2258] T b04e606670fd40f7b4ee5b86aac69d56 P a6a1e56a83b4462fb704dfce8f64e27c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:38.677722 5460 tablet_replica.cc:330] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a: stopping tablet replica
I20260812 00:00:38.677883 5460 raft_consensus.cc:2229] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:00:38.678090 5460 raft_consensus.cc:2258] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:38.678277 5459 tablet_replica.cc:330] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76: stopping tablet replica
I20260812 00:00:38.678359 5459 raft_consensus.cc:2229] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:38.678418 5459 raft_consensus.cc:2258] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:38.681234 5459 ts_tablet_manager.cc:1905] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:38.681247 5460 ts_tablet_manager.cc:1905] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:38.682976 5459 ts_tablet_manager.cc:1918] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:00:38.683194 5459 log.cc:1196] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/b04e606670fd40f7b4ee5b86aac69d56
I20260812 00:00:38.683535 5459 ts_tablet_manager.cc:1939] T b04e606670fd40f7b4ee5b86aac69d56 P e5e971af558d438796045dda98dd4d76: Deleting consensus metadata
I20260812 00:00:38.684020 5460 ts_tablet_manager.cc:1918] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:00:38.684095 5460 log.cc:1196] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/b04e606670fd40f7b4ee5b86aac69d56
I20260812 00:00:38.684109 4198 catalog_manager.cc:4841] TS e5e971af558d438796045dda98dd4d76 (127.25.103.66:34837): tablet b04e606670fd40f7b4ee5b86aac69d56 (table test-table [id=608334a74f824cd4bb87d3d93abe5089]) successfully deleted
I20260812 00:00:38.684376 5460 ts_tablet_manager.cc:1939] T b04e606670fd40f7b4ee5b86aac69d56 P 1b4242e62e514c92b33c2d883d3c3e4a: Deleting consensus metadata
I20260812 00:00:38.685040 4203 catalog_manager.cc:4841] TS 1b4242e62e514c92b33c2d883d3c3e4a (127.25.103.67:45509): tablet b04e606670fd40f7b4ee5b86aac69d56 (table test-table [id=608334a74f824cd4bb87d3d93abe5089]) successfully deleted
I20260812 00:00:38.689231 5406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:38.689068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:45815 (local address 127.0.0.1:54792)
0812 00:00:38.689140 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:38.689180 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:45815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 00:00:38.689455 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 4830
W20260812 00:00:38.689473 4203 catalog_manager.cc:4584] TS a6a1e56a83b4462fb704dfce8f64e27c (127.25.103.65:45815): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b04e606670fd40f7b4ee5b86aac69d56: Network error: Client connection negotiation failed: client connection to 127.25.103.65:45815: connect: Connection refused (error 111)
I20260812 00:00:38.700767 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 5062
I20260812 00:00:38.716365 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 4016
I20260812 00:00:38.732982 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 4317
2026-08-12T00:00:38Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5237 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:00:38 dist-test-slave-vpvm krb5kdc[5468](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:00:38 dist-test-slave-vpvm krb5kdc[5468](info): set up 2 sockets
Aug 12 00:00:38 dist-test-slave-vpvm krb5kdc[5468](info): commencing operation
krb5kdc: starting...
W20260812 00:00:39.977319 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:00:40 dist-test-slave-vpvm krb5kdc[5468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:00:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:40Z Disabled control of system clock
WARNING: no policy specified for oryx/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.126.keytab.
Entry for principal oryx/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.126.keytab.
I20260812 00:00:40.121771 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:39193
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.126.keytab
--principal=oryx/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:46589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:39193
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:40.213378 5489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:40.213649 5489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:40.213677 5489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:40.215067 5489 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:40.215147 5489 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 00:00:40.215161 5489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:40.215176 5489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:40.215189 5489 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:40.215202 5489 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:00:40.217379 5489 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:46589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:39193
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.126.keytab
--principal=oryx/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:39193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:40.217693 5489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:40.217990 5489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:40.223412 5505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:40.223421 5489 server_base.cc:1034] running on GCE node
W20260812 00:00:40.223402 5507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:40.223402 5509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:40.223889 5489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:40.224215 5489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:40.225391 5489 hybrid_clock.cc:648] HybridClock initialized: now 1786492840225360 us; error 70 us; skew 500 ppm
Aug 12 00:00:40 dist-test-slave-vpvm krb5kdc[5468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492840, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:40.228183 5489 init.cc:377] Logged in from keytab as oryx/127.25.103.126@KRBTEST.COM (short username oryx)
I20260812 00:00:40.228720 5489 webserver.cc:460] Webserver started at http://127.25.103.126:33073/ using document root <none> and password file <none>
I20260812 00:00:40.228950 5489 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:40.228998 5489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:40.229099 5489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:40.230304 5489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "71ce7f4a057d440082b4f8a89a7b968a"
format_stamp: "Formatted at 2026-08-12 00:00:40 on dist-test-slave-vpvm"
server_key: "9bdc5240bc7de836dca1873600870185"
server_key_iv: "cf730c132e9585d4b90c60e7b07f5eca"
server_key_version: "encryptionkey@0"
I20260812 00:00:40.230675 5489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "71ce7f4a057d440082b4f8a89a7b968a"
format_stamp: "Formatted at 2026-08-12 00:00:40 on dist-test-slave-vpvm"
server_key: "9bdc5240bc7de836dca1873600870185"
server_key_iv: "cf730c132e9585d4b90c60e7b07f5eca"
server_key_version: "encryptionkey@0"
I20260812 00:00:40.232546 5489 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260812 00:00:40.233862 5522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:40.234151 5489 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:00:40.234256 5489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "71ce7f4a057d440082b4f8a89a7b968a"
format_stamp: "Formatted at 2026-08-12 00:00:40 on dist-test-slave-vpvm"
server_key: "9bdc5240bc7de836dca1873600870185"
server_key_iv: "cf730c132e9585d4b90c60e7b07f5eca"
server_key_version: "encryptionkey@0"
I20260812 00:00:40.234340 5489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:40.265542 5489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:40.268498 5489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:40.268661 5489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:40.274067 5489 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:39193
I20260812 00:00:40.274253 5623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:39193 every 8 connection(s)
I20260812 00:00:40.274581 5489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:40.275465 5624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:40.278179 5624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a: Bootstrap starting.
I20260812 00:00:40.279035 5624 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:40.279424 5624 log.cc:824] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:40.279455 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 5489
I20260812 00:00:40.279561 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:00:40.279789 26013 external_mini_cluster.cc:1428] Setting key b1f6786a9657c21cf68bad1c2aad2baf
I20260812 00:00:40.281391 5624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a: No bootstrap required, opened a new log
I20260812 00:00:40.283960 5624 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71ce7f4a057d440082b4f8a89a7b968a" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39193 } }
I20260812 00:00:40.284202 5624 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:40.284245 5624 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ce7f4a057d440082b4f8a89a7b968a, State: Initialized, Role: FOLLOWER
I20260812 00:00:40.284399 5624 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71ce7f4a057d440082b4f8a89a7b968a" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39193 } }
I20260812 00:00:40.284508 5624 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:40.284554 5624 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:40.284605 5624 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:40.285322 5624 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71ce7f4a057d440082b4f8a89a7b968a" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39193 } }
I20260812 00:00:40.285446 5624 leader_election.cc:302] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71ce7f4a057d440082b4f8a89a7b968a; no voters:
I20260812 00:00:40.285681 5624 leader_election.cc:288] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:00:40.285789 5633 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:40.286005 5624 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:40.286011 5633 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a [term 1 LEADER]: Becoming Leader. State: Replica: 71ce7f4a057d440082b4f8a89a7b968a, State: Running, Role: LEADER
I20260812 00:00:40.286154 5633 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71ce7f4a057d440082b4f8a89a7b968a" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39193 } }
I20260812 00:00:40.286638 5633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71ce7f4a057d440082b4f8a89a7b968a. Latest consensus state: current_term: 1 leader_uuid: "71ce7f4a057d440082b4f8a89a7b968a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71ce7f4a057d440082b4f8a89a7b968a" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39193 } } }
I20260812 00:00:40.286726 5633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:40.286940 5635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71ce7f4a057d440082b4f8a89a7b968a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71ce7f4a057d440082b4f8a89a7b968a" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39193 } } }
I20260812 00:00:40.287039 5635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:40.287189 5638 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:40.288059 5638 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 00:00:40 dist-test-slave-vpvm krb5kdc[5468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM
I20260812 00:00:40.289907 5638 catalog_manager.cc:1347] Generated new cluster ID: 70b98b5f3dfb40ab87191113c76cf59c
I20260812 00:00:40.289991 5638 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:00:40.293378 5631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.280507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55790 (local address 127.25.103.126:39193)
0812 00:00:40.280792 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:40.280804 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:40.280857 (+ 53us) server_negotiation.cc:407] Connection header received
0812 00:00:40.281536 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:40.281549 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:40.281627 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:40.281804 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:40.282661 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.284138 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.285156 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.285827 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.285986 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.289489 (+ 3503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:40.289495 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:40.289495 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:40.289511 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:40.291248 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:40.291829 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:40.291833 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:40.291834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:40.291949 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:40.292164 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:40.292165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:40.292165 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:40.292460 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:40.292646 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:40.292755 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 00:00:40.292915 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":145,"threads_started":1}
I20260812 00:00:40.311276 5638 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:00:40.311995 5638 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:40.318588 5638 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a: Generated new TSK 0
I20260812 00:00:40.319056 5638 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.65.keytab.
Entry for principal oryx/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.65.keytab.
I20260812 00:00:40.356674 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:39193
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.65.keytab
--principal=oryx/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:46589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:40.482419 5666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:40.482719 5666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:40.482757 5666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:40.485160 5666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:40.485265 5666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:40.485296 5666 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:00:40.485316 5666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:00:40.488189 5666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:46589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.65.keytab
--principal=oryx/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.103.126:39193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:40.488827 5666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:40.489154 5666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:00:40.495657 5666 server_base.cc:1034] running on GCE node
W20260812 00:00:40.495638 5672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:40.495771 5674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:40.495638 5677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:40.496127 5666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:40.496426 5666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:40.497605 5666 hybrid_clock.cc:648] HybridClock initialized: now 1786492840497582 us; error 36 us; skew 500 ppm
Aug 12 00:00:40 dist-test-slave-vpvm krb5kdc[5468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492840, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:40.501047 5666 init.cc:377] Logged in from keytab as oryx/127.25.103.65@KRBTEST.COM (short username oryx)
I20260812 00:00:40.501518 5666 webserver.cc:460] Webserver started at http://127.25.103.65:43095/ using document root <none> and password file <none>
I20260812 00:00:40.501713 5666 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:40.501765 5666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:40.501878 5666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:40.503593 5666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "0a14a5aef4584eb396187f2f729f58e2"
format_stamp: "Formatted at 2026-08-12 00:00:40 on dist-test-slave-vpvm"
server_key: "81a07fd01c25962663e8e03162c926f3"
server_key_iv: "849cf97c98de796eb91983cda858750c"
server_key_version: "encryptionkey@0"
I20260812 00:00:40.503974 5666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "0a14a5aef4584eb396187f2f729f58e2"
format_stamp: "Formatted at 2026-08-12 00:00:40 on dist-test-slave-vpvm"
server_key: "81a07fd01c25962663e8e03162c926f3"
server_key_iv: "849cf97c98de796eb91983cda858750c"
server_key_version: "encryptionkey@0"
I20260812 00:00:40.505470 5666 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:00:40.506649 5688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:40.507018 5666 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:40.507119 5666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "0a14a5aef4584eb396187f2f729f58e2"
format_stamp: "Formatted at 2026-08-12 00:00:40 on dist-test-slave-vpvm"
server_key: "81a07fd01c25962663e8e03162c926f3"
server_key_iv: "849cf97c98de796eb91983cda858750c"
server_key_version: "encryptionkey@0"
I20260812 00:00:40.507207 5666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:40.526324 5666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:40.528899 5666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:40.529067 5666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:40.529726 5666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:40.529778 5666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:40.529808 5666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:40.529825 5666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:00:40 dist-test-slave-vpvm krb5kdc[5468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492840, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM
I20260812 00:00:40.537860 5666 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:40517
I20260812 00:00:40.537971 5862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:40517 every 8 connection(s)
I20260812 00:00:40.538343 5666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:00:40.541505 5631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.530626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:44555 (local address 127.25.103.126:39193)
0812 00:00:40.530685 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:40.530687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:40.530896 (+ 209us) server_negotiation.cc:407] Connection header received
0812 00:00:40.531515 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:40.531517 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:40.531536 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:40.531622 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:40.532352 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.532883 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.533943 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.534205 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.534266 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.537383 (+ 3117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:40.537386 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:40.537386 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:40.537394 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:40.539356 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:40.540051 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:40.540053 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:40.540053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:40.540145 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:40.540534 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:40.540534 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:40.540535 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:40.540659 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:40.540715 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:40.541281 (+ 566us) server_negotiation.cc:299] Negotiation successful
0812 00:00:40.541429 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:00:40.541688 5703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.530577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:39193 (local address 127.25.103.65:44555)
0812 00:00:40.530768 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:40.530807 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:40.531353 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:40.531719 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:40.531724 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:40.532035 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:40.532246 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:40.532251 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.532979 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.532980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:40.533850 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:40.533853 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.534288 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.534289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:40.534439 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.535097 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:40.535108 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:40.537219 (+ 2111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:40.539539 (+ 2320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:40.539549 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:40.539552 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:40.539880 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:40.540279 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:40.540281 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:40.540282 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:40.540462 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:40.540754 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:40.540762 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:40.540968 (+ 206us) client_negotiation.cc:769] Sending connection context
0812 00:00:40.541097 (+ 129us) client_negotiation.cc:240] Negotiation successful
0812 00:00:40.541435 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":96,"threads_started":1}
I20260812 00:00:40.542479 5864 heartbeater.cc:347] Connected to a master server at 127.25.103.126:39193
I20260812 00:00:40.542605 5864 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:40.542953 5864 heartbeater.cc:511] Master 127.25.103.126:39193 requested a full tablet report, sending...
I20260812 00:00:40.543850 5552 ts_manager.cc:194] Registered new tserver with Master: 0a14a5aef4584eb396187f2f729f58e2 (127.25.103.65:40517)
I20260812 00:00:40.544732 5552 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:44555
I20260812 00:00:40.545013 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 5666
I20260812 00:00:40.545111 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:00:40.545317 26013 external_mini_cluster.cc:1428] Setting key ab8a55fa360fbc0c49c2ca1b48e30cd9
I20260812 00:00:40.550544 5631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.543941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:60393 (local address 127.25.103.126:39193)
0812 00:00:40.543993 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:40.543995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:40.544166 (+ 171us) server_negotiation.cc:407] Connection header received
0812 00:00:40.544305 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:40.544306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:40.544317 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:40.544378 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:40.544794 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.545502 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.546360 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.546673 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.546758 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.547742 (+ 984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:40.547743 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:40.547744 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:40.547751 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:40.549258 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:40.549641 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:40.549642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:40.549643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:40.549706 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:40.549895 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:40.549896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:40.549896 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:40.550103 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:40.550167 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:40.550338 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 00:00:40.550434 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:00:40.550560 5878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.543849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:39193 (local address 127.25.103.65:60393)
0812 00:00:40.544063 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:40.544075 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:40.544151 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:40.544384 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:40.544385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:40.544625 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:40.544700 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:40.544702 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.545630 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.545632 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:40.546279 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:40.546283 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.546767 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.546768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:40.546831 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.547293 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:40.547297 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:40.547654 (+ 357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:40.549358 (+ 1704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:40.549359 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:40.549360 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:40.549568 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:40.549770 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:40.549771 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:40.549771 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:40.549836 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:40.550178 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:40.550180 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:40.550239 (+ 59us) client_negotiation.cc:769] Sending connection context
0812 00:00:40.550303 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 00:00:40.550436 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":108,"threads_started":1}
WARNING: no policy specified for oryx/127.25.103.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.66.keytab.
Entry for principal oryx/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.66.keytab.
I20260812 00:00:40.573683 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:39193
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.66.keytab
--principal=oryx/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:46589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:40.672571 5884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:40.672852 5884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:40.672904 5884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:40.674285 5884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:40.674351 5884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:40.674388 5884 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:00:40.674419 5884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:00:40.676194 5884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:46589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.66.keytab
--principal=oryx/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.103.126:39193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:40.676504 5884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:40.676882 5884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:40.682652 5897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:40.682674 5900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:40.682667 5902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:40.682914 5884 server_base.cc:1034] running on GCE node
I20260812 00:00:40.683152 5884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:40.683439 5884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:40.684619 5884 hybrid_clock.cc:648] HybridClock initialized: now 1786492840684598 us; error 59 us; skew 500 ppm
Aug 12 00:00:40 dist-test-slave-vpvm krb5kdc[5468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492840, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:40.688030 5884 init.cc:377] Logged in from keytab as oryx/127.25.103.66@KRBTEST.COM (short username oryx)
I20260812 00:00:40.688726 5884 webserver.cc:460] Webserver started at http://127.25.103.66:41109/ using document root <none> and password file <none>
I20260812 00:00:40.688973 5884 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:40.689031 5884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:40.689175 5884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:40.690547 5884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "aec5ca9e75804c98b8cbc6946092cae9"
format_stamp: "Formatted at 2026-08-12 00:00:40 on dist-test-slave-vpvm"
server_key: "dd80a5c4703156999e233eb2ec612685"
server_key_iv: "7c35a9a8022e96904d35e0fd7d1df3a5"
server_key_version: "encryptionkey@0"
I20260812 00:00:40.691015 5884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "aec5ca9e75804c98b8cbc6946092cae9"
format_stamp: "Formatted at 2026-08-12 00:00:40 on dist-test-slave-vpvm"
server_key: "dd80a5c4703156999e233eb2ec612685"
server_key_iv: "7c35a9a8022e96904d35e0fd7d1df3a5"
server_key_version: "encryptionkey@0"
I20260812 00:00:40.692857 5884 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 00:00:40.693813 5911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:40.694042 5884 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:40.694139 5884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "aec5ca9e75804c98b8cbc6946092cae9"
format_stamp: "Formatted at 2026-08-12 00:00:40 on dist-test-slave-vpvm"
server_key: "dd80a5c4703156999e233eb2ec612685"
server_key_iv: "7c35a9a8022e96904d35e0fd7d1df3a5"
server_key_version: "encryptionkey@0"
I20260812 00:00:40.694216 5884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:40.712374 5884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:40.714951 5884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:40.715104 5884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:40.715692 5884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:40.715749 5884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:40.715791 5884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:40.715819 5884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:40.724193 5884 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:42577
I20260812 00:00:40.724256 6098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:42577 every 8 connection(s)
Aug 12 00:00:40 dist-test-slave-vpvm krb5kdc[5468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492840, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM
I20260812 00:00:40.724951 5884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:00:40.729413 5631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.716649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:48881 (local address 127.25.103.126:39193)
0812 00:00:40.716743 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:40.716746 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:40.716991 (+ 245us) server_negotiation.cc:407] Connection header received
0812 00:00:40.717805 (+ 814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:40.717807 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:40.717827 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:40.717985 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:40.719187 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.719958 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.722019 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.722313 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.722432 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.725821 (+ 3389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:40.725824 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:40.725824 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:40.725836 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:40.727340 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:40.727866 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:40.727867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:40.727867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:40.727940 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:40.728329 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:40.728331 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:40.728331 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:40.728605 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:40.728684 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:40.729214 (+ 530us) server_negotiation.cc:299] Negotiation successful
0812 00:00:40.729333 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 00:00:40.729584 5927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.716571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:39193 (local address 127.25.103.66:48881)
0812 00:00:40.716821 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:40.716873 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:40.717654 (+ 781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:40.718087 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:40.718092 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:40.718539 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:40.719045 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:40.719056 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.720100 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.720101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:40.721833 (+ 1732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:40.721842 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.722491 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.722493 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:40.722648 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.723361 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:40.723373 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:40.725677 (+ 2304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:40.727451 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:40.727461 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:40.727464 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:40.727755 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:40.728041 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:40.728042 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:40.728042 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:40.728177 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:40.728751 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:40.728765 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:40.728980 (+ 215us) client_negotiation.cc:769] Sending connection context
0812 00:00:40.729132 (+ 152us) client_negotiation.cc:240] Negotiation successful
0812 00:00:40.729336 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":145,"threads_started":1}
I20260812 00:00:40.730230 6099 heartbeater.cc:347] Connected to a master server at 127.25.103.126:39193
I20260812 00:00:40.730338 6099 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:40.730571 6099 heartbeater.cc:511] Master 127.25.103.126:39193 requested a full tablet report, sending...
I20260812 00:00:40.730708 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 5884
I20260812 00:00:40.730816 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:00:40.731025 26013 external_mini_cluster.cc:1428] Setting key f7aa8fee5a1b7cb3b4091498c64b0caf
I20260812 00:00:40.731027 5552 ts_manager.cc:194] Registered new tserver with Master: aec5ca9e75804c98b8cbc6946092cae9 (127.25.103.66:42577)
I20260812 00:00:40.731621 5552 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:48881
I20260812 00:00:40.738071 6106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.731473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:39193 (local address 127.25.103.66:34887)
0812 00:00:40.731734 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:40.731745 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:40.731808 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:40.731958 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:40.731959 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:40.732193 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:40.732252 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:40.732254 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.732928 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.732929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:40.733455 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:40.733456 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.733938 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.733939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:40.734044 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.734527 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:40.734532 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:40.734893 (+ 361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:40.736864 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:40.736866 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:40.736866 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:40.737065 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:40.737284 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:40.737285 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:40.737285 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:40.737343 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:40.737704 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:40.737705 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:40.737752 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 00:00:40.737805 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 00:00:40.737908 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":187,"threads_started":1}
I20260812 00:00:40.738153 5631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.731626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:34887 (local address 127.25.103.126:39193)
0812 00:00:40.731676 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:40.731678 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:40.731796 (+ 118us) server_negotiation.cc:407] Connection header received
0812 00:00:40.731883 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:40.731884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:40.731897 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:40.731955 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:40.732336 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.732830 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.733545 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.733851 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.733922 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.734999 (+ 1077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:40.735001 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:40.735002 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:40.735009 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:40.736745 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:40.737148 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:40.737149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:40.737149 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:40.737216 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:40.737397 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:40.737398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:40.737399 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:40.737630 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:40.737713 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:40.737857 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 00:00:40.738031 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
WARNING: no policy specified for oryx/127.25.103.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.67.keytab.
Entry for principal oryx/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.67.keytab.
I20260812 00:00:40.762079 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:39193
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.67.keytab
--principal=oryx/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:46589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:40.859541 6109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:40.860036 6109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:40.860096 6109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:40.862447 6109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:40.862542 6109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:40.862579 6109 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:00:40.862607 6109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:00:40.864770 6109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:46589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.67.keytab
--principal=oryx/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.103.126:39193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:40.865090 6109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:40.865339 6109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:40.872030 6121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:40.872210 6119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:40.872030 6118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:40.872368 6109 server_base.cc:1034] running on GCE node
I20260812 00:00:40.872630 6109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:40.872937 6109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:40.874089 6109 hybrid_clock.cc:648] HybridClock initialized: now 1786492840874063 us; error 46 us; skew 500 ppm
Aug 12 00:00:40 dist-test-slave-vpvm krb5kdc[5468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492840, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:40.881699 6109 init.cc:377] Logged in from keytab as oryx/127.25.103.67@KRBTEST.COM (short username oryx)
I20260812 00:00:40.882472 6109 webserver.cc:460] Webserver started at http://127.25.103.67:35473/ using document root <none> and password file <none>
I20260812 00:00:40.882773 6109 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:40.882834 6109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:40.882983 6109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:40.884305 6109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "a159f8e5c5b34a309ca7dee01d56f0de"
format_stamp: "Formatted at 2026-08-12 00:00:40 on dist-test-slave-vpvm"
server_key: "a6f4b7a2f77e297809f862ff8223f226"
server_key_iv: "aa5d94044a90d4ccec64e5dcb043c74c"
server_key_version: "encryptionkey@0"
I20260812 00:00:40.884719 6109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "a159f8e5c5b34a309ca7dee01d56f0de"
format_stamp: "Formatted at 2026-08-12 00:00:40 on dist-test-slave-vpvm"
server_key: "a6f4b7a2f77e297809f862ff8223f226"
server_key_iv: "aa5d94044a90d4ccec64e5dcb043c74c"
server_key_version: "encryptionkey@0"
I20260812 00:00:40.886751 6109 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 00:00:40.887959 6130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:40.888254 6109 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:40.888379 6109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "a159f8e5c5b34a309ca7dee01d56f0de"
format_stamp: "Formatted at 2026-08-12 00:00:40 on dist-test-slave-vpvm"
server_key: "a6f4b7a2f77e297809f862ff8223f226"
server_key_iv: "aa5d94044a90d4ccec64e5dcb043c74c"
server_key_version: "encryptionkey@0"
I20260812 00:00:40.888494 6109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:40.896924 6109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:40.899423 6109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:40.899556 6109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:40.900343 6109 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:40.900432 6109 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:40.900475 6109 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:40.900491 6109 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:00:40 dist-test-slave-vpvm krb5kdc[5468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492840, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM
I20260812 00:00:40.909885 6109 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:36769
I20260812 00:00:40.910019 6306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:36769 every 8 connection(s)
I20260812 00:00:40.910410 6109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:00:40.914161 5631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.900642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:36699 (local address 127.25.103.126:39193)
0812 00:00:40.900734 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:40.900737 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:40.901097 (+ 360us) server_negotiation.cc:407] Connection header received
0812 00:00:40.902079 (+ 982us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:40.902081 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:40.902094 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:40.902165 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:40.903412 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.903991 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.905815 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.906171 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.906260 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.910004 (+ 3744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:40.910007 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:40.910008 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:40.910020 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:40.912031 (+ 2011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:40.912586 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:40.912587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:40.912588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:40.912670 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:40.913182 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:40.913183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:40.913184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:40.913461 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:40.913534 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:40.913936 (+ 402us) server_negotiation.cc:299] Negotiation successful
0812 00:00:40.914080 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 00:00:40.914361 6139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.900591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:39193 (local address 127.25.103.67:36699)
0812 00:00:40.900847 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:40.900908 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:40.901791 (+ 883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:40.902298 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:40.902305 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:40.902803 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:40.903246 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:40.903254 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.904130 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.904132 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:40.905679 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:40.905684 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.906306 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.906307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:40.906515 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.907278 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:40.907292 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:40.909787 (+ 2495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:40.912182 (+ 2395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:40.912189 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:40.912192 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:40.912468 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:40.912819 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:40.912822 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:40.912822 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:40.913034 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:40.913600 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:40.913608 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:40.913774 (+ 166us) client_negotiation.cc:769] Sending connection context
0812 00:00:40.913878 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 00:00:40.914112 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":98,"threads_started":1}
I20260812 00:00:40.914953 6307 heartbeater.cc:347] Connected to a master server at 127.25.103.126:39193
I20260812 00:00:40.915056 6307 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:40.915271 6307 heartbeater.cc:511] Master 127.25.103.126:39193 requested a full tablet report, sending...
I20260812 00:00:40.915714 5551 ts_manager.cc:194] Registered new tserver with Master: a159f8e5c5b34a309ca7dee01d56f0de (127.25.103.67:36769)
I20260812 00:00:40.916218 5551 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:36699
I20260812 00:00:40.919807 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 6109
I20260812 00:00:40.919896 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:00:40.920063 26013 external_mini_cluster.cc:1428] Setting key 8cde9d88dd54035223d248d5a809d80c
I20260812 00:00:40.921097 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:00:40.923162 6316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.916054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:39193 (local address 127.25.103.67:47091)
0812 00:00:40.916210 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:40.916221 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:40.916273 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:40.916493 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:40.916495 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:40.916733 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:40.916819 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:40.916822 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.917536 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.917537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:40.918159 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:40.918162 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.918504 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.918505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:40.918575 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.919135 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:40.919141 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:40.919559 (+ 418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:40.921994 (+ 2435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:40.921996 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:40.921997 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:40.922218 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:40.922459 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:40.922460 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:40.922460 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:40.922526 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:40.922839 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:40.922839 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:40.922896 (+ 57us) client_negotiation.cc:769] Sending connection context
0812 00:00:40.922952 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 00:00:40.923063 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":82,"threads_started":1}
I20260812 00:00:40.923413 5631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.916256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:47091 (local address 127.25.103.126:39193)
0812 00:00:40.916343 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:40.916345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:40.916357 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:00:40.916384 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:40.916385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:40.916397 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:40.916475 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:40.916898 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.917437 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.918247 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.918445 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.918501 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.920029 (+ 1528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:40.920031 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:40.920032 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:40.920041 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:40.921788 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:40.922294 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:40.922295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:40.922295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:40.922364 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:40.922579 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:40.922580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:40.922580 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:40.922748 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:40.922817 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:40.922994 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 00:00:40.923280 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Aug 12 00:00:40 dist-test-slave-vpvm krb5kdc[5468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492840, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:00:40 dist-test-slave-vpvm krb5kdc[5468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:40 dist-test-slave-vpvm krb5kdc[5468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:00:40.950821 5631 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:40.943588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55800 (local address 127.25.103.126:39193)
0812 00:00:40.943718 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:40.943720 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:40.943757 (+ 37us) server_negotiation.cc:407] Connection header received
0812 00:00:40.943793 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:40.943795 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:40.943806 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:40.943853 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:40.944617 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.945207 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.946041 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.946248 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.946318 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.950613 (+ 4295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55800: BlockingRecv error: recv got EOF from 127.0.0.1:55800 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 12 00:00:40 dist-test-slave-vpvm krb5kdc[5468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492840, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM
I20260812 00:00:40.959292 5631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.951609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55804 (local address 127.25.103.126:39193)
0812 00:00:40.951682 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:40.951684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:40.951756 (+ 72us) server_negotiation.cc:407] Connection header received
0812 00:00:40.951923 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:40.951925 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:40.951939 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:40.951989 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:40.952513 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.953052 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.953740 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.953939 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.954033 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.956286 (+ 2253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:40.956288 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:40.956289 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:40.956297 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:40.957786 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:40.958382 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:40.958383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:40.958384 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:40.958465 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:40.958781 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:40.958782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:40.958782 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:40.958922 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:40.959030 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:40.959148 (+ 118us) server_negotiation.cc:299] Negotiation successful
0812 00:00:40.959218 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 00:00:40.961334 5551 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55804:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:00:40.963148 5551 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:00:40.972055 6348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.966624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36624 (local address 127.25.103.67:36769)
0812 00:00:40.966870 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:40.967003 (+ 133us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:40.967096 (+ 93us) server_negotiation.cc:407] Connection header received
0812 00:00:40.967209 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:40.967212 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:40.967228 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:40.967300 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:40.967506 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.968811 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.970642 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.971401 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.971467 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.971563 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:40.971888 (+ 325us) server_negotiation.cc:299] Negotiation successful
0812 00:00:40.971941 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":119,"threads_started":1}
I20260812 00:00:40.972345 6343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.966249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:40517 (local address 127.0.0.1:56406)
0812 00:00:40.967395 (+ 1146us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:40.967405 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:40.967464 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:40.969177 (+ 1713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:40.969178 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:40.969181 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:40.969235 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:40.969237 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.970180 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.970181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:40.971090 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:40.971093 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.972074 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.972075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:40.972138 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.972142 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:00:40.972195 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 00:00:40.972261 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1133,"thread_start_us":107,"threads_started":1}
I20260812 00:00:40.972581 6339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.966243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:36769 (local address 127.0.0.1:36624)
0812 00:00:40.966989 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:40.966998 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:40.967045 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:40.967313 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:40.967314 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:40.967318 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:40.967412 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:40.967415 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.969030 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.969030 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:40.970538 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:40.970541 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.971502 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.971503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:40.971707 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.971728 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 00:00:40.972323 (+ 595us) client_negotiation.cc:240] Negotiation successful
0812 00:00:40.972380 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":727,"mutex_wait_us":55,"thread_start_us":145,"threads_started":1}
I20260812 00:00:40.972630 6347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.966620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56406 (local address 127.25.103.65:40517)
0812 00:00:40.967084 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:40.967088 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:40.968943 (+ 1855us) server_negotiation.cc:407] Connection header received
0812 00:00:40.968999 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:40.969002 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:40.969022 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:40.969099 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:40.969309 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.970102 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.971200 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.971990 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.972058 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.972127 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:40.972480 (+ 353us) server_negotiation.cc:299] Negotiation successful
0812 00:00:40.972528 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":98,"threads_started":1}
I20260812 00:00:40.972810 6341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.966232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:42577 (local address 127.0.0.1:54302)
0812 00:00:40.966734 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:40.966787 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:40.966871 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:40.967209 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:40.967214 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:40.967216 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:40.967316 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:40.967318 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.968960 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.968962 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:40.970539 (+ 1577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:40.970541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.972570 (+ 2029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.972571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:40.972649 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.972654 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:00:40.972714 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 00:00:40.972762 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"mutex_wait_us":30,"thread_start_us":167,"threads_started":1}
I20260812 00:00:40.973129 6345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:40.966383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54302 (local address 127.25.103.66:42577)
0812 00:00:40.966895 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:40.966901 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:40.966915 (+ 14us) server_negotiation.cc:407] Connection header received
0812 00:00:40.966980 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:40.966982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:40.967001 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:40.967086 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:40.967396 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.968871 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.971616 (+ 2745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:40.972366 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:40.972433 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:40.972508 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:40.972970 (+ 462us) server_negotiation.cc:299] Negotiation successful
0812 00:00:40.973030 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":147,"threads_started":1}
I20260812 00:00:40.973383 6205 tablet_service.cc:1467] Processing CreateTablet for tablet 0f5070f7d8144419a27a4a29122e93ce (DEFAULT_TABLE table=test-table [id=0ac927dd02ae47a08d86e0b28bab3a4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:40.973768 6205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f5070f7d8144419a27a4a29122e93ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:40.973690 5989 tablet_service.cc:1467] Processing CreateTablet for tablet 0f5070f7d8144419a27a4a29122e93ce (DEFAULT_TABLE table=test-table [id=0ac927dd02ae47a08d86e0b28bab3a4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:40.974045 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f5070f7d8144419a27a4a29122e93ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:40.977209 6349 tablet_bootstrap.cc:492] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de: Bootstrap starting.
I20260812 00:00:40.977669 6350 tablet_bootstrap.cc:492] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9: Bootstrap starting.
I20260812 00:00:40.977643 5762 tablet_service.cc:1467] Processing CreateTablet for tablet 0f5070f7d8144419a27a4a29122e93ce (DEFAULT_TABLE table=test-table [id=0ac927dd02ae47a08d86e0b28bab3a4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:40.978013 5762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f5070f7d8144419a27a4a29122e93ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:40.978049 6349 tablet_bootstrap.cc:654] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:40.978304 6350 tablet_bootstrap.cc:654] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:40.978515 6349 log.cc:824] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:40.978612 6350 log.cc:824] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:40.979346 6349 tablet_bootstrap.cc:492] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de: No bootstrap required, opened a new log
I20260812 00:00:40.979346 6350 tablet_bootstrap.cc:492] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9: No bootstrap required, opened a new log
I20260812 00:00:40.979421 6349 ts_tablet_manager.cc:1397] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:00:40.979421 6350 ts_tablet_manager.cc:1397] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:40.981350 6354 tablet_bootstrap.cc:492] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2: Bootstrap starting.
I20260812 00:00:40.981431 6350 raft_consensus.cc:348] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } }
I20260812 00:00:40.981431 6349 raft_consensus.cc:348] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } }
I20260812 00:00:40.981632 6349 raft_consensus.cc:374] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:40.981632 6350 raft_consensus.cc:374] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:40.981670 6349 raft_consensus.cc:729] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a159f8e5c5b34a309ca7dee01d56f0de, State: Initialized, Role: FOLLOWER
I20260812 00:00:40.981670 6350 raft_consensus.cc:729] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5ca9e75804c98b8cbc6946092cae9, State: Initialized, Role: FOLLOWER
I20260812 00:00:40.981799 6349 consensus_queue.cc:260] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } }
I20260812 00:00:40.981817 6350 consensus_queue.cc:260] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } }
I20260812 00:00:40.982138 6350 ts_tablet_manager.cc:1428] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:00:40.982138 6349 ts_tablet_manager.cc:1428] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:00:40.982191 6354 tablet_bootstrap.cc:654] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:40.982342 6099 heartbeater.cc:503] Master 127.25.103.126:39193 was elected leader, sending a full tablet report...
I20260812 00:00:40.982366 6307 heartbeater.cc:503] Master 127.25.103.126:39193 was elected leader, sending a full tablet report...
I20260812 00:00:40.982553 6354 log.cc:824] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:40.983422 6354 tablet_bootstrap.cc:492] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2: No bootstrap required, opened a new log
I20260812 00:00:40.983497 6354 ts_tablet_manager.cc:1397] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:40.984913 6354 raft_consensus.cc:348] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } }
I20260812 00:00:40.985076 6354 raft_consensus.cc:374] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:40.985100 6354 raft_consensus.cc:729] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a14a5aef4584eb396187f2f729f58e2, State: Initialized, Role: FOLLOWER
I20260812 00:00:40.985203 6354 consensus_queue.cc:260] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } }
I20260812 00:00:40.985483 6354 ts_tablet_manager.cc:1428] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:00:40.985668 5864 heartbeater.cc:503] Master 127.25.103.126:39193 was elected leader, sending a full tablet report...
W20260812 00:00:41.041636 5865 tablet.cc:2369] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:00:41.099061 6356 raft_consensus.cc:482] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:00:41.099211 6356 raft_consensus.cc:504] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } }
I20260812 00:00:41.099617 6356 leader_election.cc:288] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aec5ca9e75804c98b8cbc6946092cae9 (127.25.103.66:42577), 0a14a5aef4584eb396187f2f729f58e2 (127.25.103.65:40517)
I20260812 00:00:41.102798 6347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.099953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:51409 (local address 127.25.103.65:40517)
0812 00:00:41.100007 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:41.100009 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:41.100026 (+ 17us) server_negotiation.cc:407] Connection header received
0812 00:00:41.100142 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:41.100143 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:41.100152 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:41.100209 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:41.100390 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.100960 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.102031 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.102438 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.102502 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.102513 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:41.102675 (+ 162us) server_negotiation.cc:299] Negotiation successful
0812 00:00:41.102719 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:00:41.102792 6345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.100031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:35095 (local address 127.25.103.66:42577)
0812 00:00:41.100073 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:41.100075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:41.100260 (+ 185us) server_negotiation.cc:407] Connection header received
0812 00:00:41.100307 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:41.100308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:41.100319 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:41.100368 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:41.100550 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.101067 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.102039 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.102427 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.102495 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.102507 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:41.102647 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 00:00:41.102698 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:00:41.102847 6139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.099848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:40517 (local address 127.25.103.67:51409)
0812 00:00:41.099940 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:41.099959 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:41.100027 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:41.100239 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:41.100241 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:41.100244 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:41.100323 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:41.100324 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.101045 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.101047 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:41.101893 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:41.101896 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.102509 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.102510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:41.102607 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.102611 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:00:41.102659 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 00:00:41.102719 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 00:00:41.102837 6366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.099967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:42577 (local address 127.25.103.67:35095)
0812 00:00:41.100176 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:41.100185 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:41.100250 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:41.100375 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:41.100376 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:41.100378 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:41.100485 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:41.100488 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.101142 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.101143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:41.101940 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:41.101942 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.102502 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.102503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:41.102581 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.102585 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:00:41.102633 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 00:00:41.102693 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":1,"thread_start_us":146,"threads_started":1}
I20260812 00:00:41.103446 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f5070f7d8144419a27a4a29122e93ce" candidate_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5ca9e75804c98b8cbc6946092cae9" is_pre_election: true
I20260812 00:00:41.103406 5797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f5070f7d8144419a27a4a29122e93ce" candidate_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a14a5aef4584eb396187f2f729f58e2" is_pre_election: true
I20260812 00:00:41.103727 6022 raft_consensus.cc:2454] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a159f8e5c5b34a309ca7dee01d56f0de in term 0.
I20260812 00:00:41.103645 5797 raft_consensus.cc:2454] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a159f8e5c5b34a309ca7dee01d56f0de in term 0.
I20260812 00:00:41.104173 6132 leader_election.cc:302] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a159f8e5c5b34a309ca7dee01d56f0de, aec5ca9e75804c98b8cbc6946092cae9; no voters:
I20260812 00:00:41.104390 6356 raft_consensus.cc:2781] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:00:41.104454 6356 raft_consensus.cc:482] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:00:41.104478 6356 raft_consensus.cc:3037] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:41.105551 6356 raft_consensus.cc:504] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } }
I20260812 00:00:41.105717 6356 leader_election.cc:288] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [CANDIDATE]: Term 1 election: Requested vote from peers aec5ca9e75804c98b8cbc6946092cae9 (127.25.103.66:42577), 0a14a5aef4584eb396187f2f729f58e2 (127.25.103.65:40517)
I20260812 00:00:41.105911 5797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f5070f7d8144419a27a4a29122e93ce" candidate_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a14a5aef4584eb396187f2f729f58e2"
I20260812 00:00:41.105985 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f5070f7d8144419a27a4a29122e93ce" candidate_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5ca9e75804c98b8cbc6946092cae9"
I20260812 00:00:41.106050 5797 raft_consensus.cc:3037] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:41.106094 6022 raft_consensus.cc:3037] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:41.106824 5797 raft_consensus.cc:2454] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a159f8e5c5b34a309ca7dee01d56f0de in term 1.
I20260812 00:00:41.107081 6131 leader_election.cc:302] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a14a5aef4584eb396187f2f729f58e2, a159f8e5c5b34a309ca7dee01d56f0de; no voters:
I20260812 00:00:41.107240 6356 raft_consensus.cc:2781] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:41.107254 6022 raft_consensus.cc:2454] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a159f8e5c5b34a309ca7dee01d56f0de in term 1.
I20260812 00:00:41.107468 6356 raft_consensus.cc:686] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [term 1 LEADER]: Becoming Leader. State: Replica: a159f8e5c5b34a309ca7dee01d56f0de, State: Running, Role: LEADER
I20260812 00:00:41.107590 6356 consensus_queue.cc:237] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } }
I20260812 00:00:41.108860 5551 catalog_manager.cc:5495] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de reported cstate change: term changed from 0 to 1, leader changed from <none> to a159f8e5c5b34a309ca7dee01d56f0de (127.25.103.67). New cstate: current_term: 1 leader_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } health_report { overall_health: UNKNOWN } } }
I20260812 00:00:41.121755 6348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.118604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36630 (local address 127.25.103.67:36769)
0812 00:00:41.118666 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:41.118668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:41.118694 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:00:41.118734 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:41.118735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:41.118753 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:41.118810 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:41.119085 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.119643 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.120564 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.120773 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.120851 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.121274 (+ 423us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:41.121425 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:41.121514 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:41.121635 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 00:00:41.121664 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:00:41.124221 5797 raft_consensus.cc:1261] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2 [term 1 FOLLOWER]: Refusing update from remote peer a159f8e5c5b34a309ca7dee01d56f0de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:41.124326 6022 raft_consensus.cc:1261] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9 [term 1 FOLLOWER]: Refusing update from remote peer a159f8e5c5b34a309ca7dee01d56f0de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:41.124629 6367 consensus_queue.cc:1035] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:41.124867 6356 consensus_queue.cc:1035] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:41.127887 6373 mvcc.cc:205] Tried to move back new op lower bound from 7317474677241511936 to 7317474677177970688. Current Snapshot: MvccSnapshot[applied={T|T < 7317474677241511936}]
I20260812 00:00:41.128532 6380 mvcc.cc:205] Tried to move back new op lower bound from 7317474677241511936 to 7317474677177970688. Current Snapshot: MvccSnapshot[applied={T|T < 7317474677241511936}]
I20260812 00:00:41.128983 6375 mvcc.cc:205] Tried to move back new op lower bound from 7317474677241511936 to 7317474677177970688. Current Snapshot: MvccSnapshot[applied={T|T < 7317474677241511936}]
I20260812 00:00:41.131387 5552 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:41.131518 5552 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:41.132503 5552 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a: Sending DeleteTablet for 3 replicas of tablet 0f5070f7d8144419a27a4a29122e93ce
I20260812 00:00:41.132910 6205 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f5070f7d8144419a27a4a29122e93ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:41 UTC) from {username='oryx', principal='oryx/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:36624
I20260812 00:00:41.132934 5989 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f5070f7d8144419a27a4a29122e93ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:41 UTC) from {username='oryx', principal='oryx/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:54302
I20260812 00:00:41.133030 5762 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f5070f7d8144419a27a4a29122e93ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:41 UTC) from {username='oryx', principal='oryx/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:56406
I20260812 00:00:41.133236 5552 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55804:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:00:41.133383 5552 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:00:41.133579 6392 tablet_replica.cc:330] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2: stopping tablet replica
I20260812 00:00:41.133718 6392 raft_consensus.cc:2229] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:41.133821 6392 raft_consensus.cc:2258] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:41.133616 6390 tablet_replica.cc:330] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de: stopping tablet replica
I20260812 00:00:41.134404 6391 tablet_replica.cc:330] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9: stopping tablet replica
I20260812 00:00:41.134506 6391 raft_consensus.cc:2229] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:41.134822 6391 raft_consensus.cc:2258] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:41.135452 5762 tablet_service.cc:1467] Processing CreateTablet for tablet d7a46d82c96e423bbf63a06294ba5f58 (DEFAULT_TABLE table=test-table [id=6ec71940b3a04061931a04a6d6f7ca4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:41.135456 5989 tablet_service.cc:1467] Processing CreateTablet for tablet d7a46d82c96e423bbf63a06294ba5f58 (DEFAULT_TABLE table=test-table [id=6ec71940b3a04061931a04a6d6f7ca4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:41.135622 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7a46d82c96e423bbf63a06294ba5f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:41.135622 5762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7a46d82c96e423bbf63a06294ba5f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:41.136147 6390 raft_consensus.cc:2229] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:00:41.136377 6390 raft_consensus.cc:2258] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:41.137058 6350 tablet_bootstrap.cc:492] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9: Bootstrap starting.
I20260812 00:00:41.137053 6390 ts_tablet_manager.cc:1905] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:41.137475 6350 tablet_bootstrap.cc:654] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:41.137771 6354 tablet_bootstrap.cc:492] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2: Bootstrap starting.
I20260812 00:00:41.138100 6350 tablet_bootstrap.cc:492] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9: No bootstrap required, opened a new log
I20260812 00:00:41.138155 6350 ts_tablet_manager.cc:1397] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 00:00:41.138193 6354 tablet_bootstrap.cc:654] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:41.138324 6350 raft_consensus.cc:348] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.138427 6350 raft_consensus.cc:374] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:41.138448 6350 raft_consensus.cc:729] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5ca9e75804c98b8cbc6946092cae9, State: Initialized, Role: FOLLOWER
I20260812 00:00:41.138509 6350 consensus_queue.cc:260] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.138604 6350 ts_tablet_manager.cc:1428] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 00:00:41.138953 6205 tablet_service.cc:1467] Processing CreateTablet for tablet d7a46d82c96e423bbf63a06294ba5f58 (DEFAULT_TABLE table=test-table [id=6ec71940b3a04061931a04a6d6f7ca4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:41.139247 6205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7a46d82c96e423bbf63a06294ba5f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:41.139271 6392 ts_tablet_manager.cc:1905] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:41.140384 6392 ts_tablet_manager.cc:1918] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:00:41.140442 6392 log.cc:1196] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/wal/wals/0f5070f7d8144419a27a4a29122e93ce
I20260812 00:00:41.140647 6392 ts_tablet_manager.cc:1939] T 0f5070f7d8144419a27a4a29122e93ce P 0a14a5aef4584eb396187f2f729f58e2: Deleting consensus metadata
I20260812 00:00:41.140651 6349 tablet_bootstrap.cc:492] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de: Bootstrap starting.
I20260812 00:00:41.141093 6349 tablet_bootstrap.cc:654] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:41.141330 5523 catalog_manager.cc:4841] TS 0a14a5aef4584eb396187f2f729f58e2 (127.25.103.65:40517): tablet 0f5070f7d8144419a27a4a29122e93ce (table test-table [id=0ac927dd02ae47a08d86e0b28bab3a4d]) successfully deleted
I20260812 00:00:41.141897 6354 tablet_bootstrap.cc:492] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2: No bootstrap required, opened a new log
I20260812 00:00:41.141990 6354 ts_tablet_manager.cc:1397] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260812 00:00:41.141928 6390 ts_tablet_manager.cc:1918] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:00:41.142171 6349 tablet_bootstrap.cc:492] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de: No bootstrap required, opened a new log
I20260812 00:00:41.142160 6354 raft_consensus.cc:348] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.142253 6354 raft_consensus.cc:374] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:41.142282 6354 raft_consensus.cc:729] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a14a5aef4584eb396187f2f729f58e2, State: Initialized, Role: FOLLOWER
I20260812 00:00:41.142192 6390 log.cc:1196] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/0f5070f7d8144419a27a4a29122e93ce
I20260812 00:00:41.142334 6354 consensus_queue.cc:260] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.142220 6349 ts_tablet_manager.cc:1397] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:00:41.142624 6349 raft_consensus.cc:348] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.142678 6354 ts_tablet_manager.cc:1428] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 00:00:41.142709 6349 raft_consensus.cc:374] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:41.142729 6349 raft_consensus.cc:729] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a159f8e5c5b34a309ca7dee01d56f0de, State: Initialized, Role: FOLLOWER
I20260812 00:00:41.142768 6349 consensus_queue.cc:260] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.142848 6349 ts_tablet_manager.cc:1428] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:41.142957 6390 ts_tablet_manager.cc:1939] T 0f5070f7d8144419a27a4a29122e93ce P a159f8e5c5b34a309ca7dee01d56f0de: Deleting consensus metadata
I20260812 00:00:41.143464 5529 catalog_manager.cc:4841] TS a159f8e5c5b34a309ca7dee01d56f0de (127.25.103.67:36769): tablet 0f5070f7d8144419a27a4a29122e93ce (table test-table [id=0ac927dd02ae47a08d86e0b28bab3a4d]) successfully deleted
I20260812 00:00:41.143524 6391 ts_tablet_manager.cc:1905] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:41.144863 6391 ts_tablet_manager.cc:1918] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:00:41.144932 6391 log.cc:1196] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/0f5070f7d8144419a27a4a29122e93ce
I20260812 00:00:41.145118 6391 ts_tablet_manager.cc:1939] T 0f5070f7d8144419a27a4a29122e93ce P aec5ca9e75804c98b8cbc6946092cae9: Deleting consensus metadata
I20260812 00:00:41.145507 5525 catalog_manager.cc:4841] TS aec5ca9e75804c98b8cbc6946092cae9 (127.25.103.66:42577): tablet 0f5070f7d8144419a27a4a29122e93ce (table test-table [id=0ac927dd02ae47a08d86e0b28bab3a4d]) successfully deleted
W20260812 00:00:41.161118 6308 tablet.cc:2369] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:00:41.177314 6356 raft_consensus.cc:482] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:00:41.177452 6356 raft_consensus.cc:504] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.177696 6356 leader_election.cc:288] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a14a5aef4584eb396187f2f729f58e2 (127.25.103.65:40517), aec5ca9e75804c98b8cbc6946092cae9 (127.25.103.66:42577)
I20260812 00:00:41.178016 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7a46d82c96e423bbf63a06294ba5f58" candidate_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5ca9e75804c98b8cbc6946092cae9" is_pre_election: true
I20260812 00:00:41.178030 5797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7a46d82c96e423bbf63a06294ba5f58" candidate_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a14a5aef4584eb396187f2f729f58e2" is_pre_election: true
I20260812 00:00:41.178140 6022 raft_consensus.cc:2454] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a159f8e5c5b34a309ca7dee01d56f0de in term 0.
I20260812 00:00:41.178184 5797 raft_consensus.cc:2454] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a159f8e5c5b34a309ca7dee01d56f0de in term 0.
I20260812 00:00:41.178316 6132 leader_election.cc:302] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a159f8e5c5b34a309ca7dee01d56f0de, aec5ca9e75804c98b8cbc6946092cae9; no voters:
I20260812 00:00:41.178438 6356 raft_consensus.cc:2781] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:00:41.178512 6356 raft_consensus.cc:482] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:00:41.178536 6356 raft_consensus.cc:3037] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:41.179518 6356 raft_consensus.cc:504] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.179733 6356 leader_election.cc:288] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [CANDIDATE]: Term 1 election: Requested vote from peers 0a14a5aef4584eb396187f2f729f58e2 (127.25.103.65:40517), aec5ca9e75804c98b8cbc6946092cae9 (127.25.103.66:42577)
I20260812 00:00:41.179937 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7a46d82c96e423bbf63a06294ba5f58" candidate_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5ca9e75804c98b8cbc6946092cae9"
I20260812 00:00:41.179949 5797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7a46d82c96e423bbf63a06294ba5f58" candidate_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a14a5aef4584eb396187f2f729f58e2"
I20260812 00:00:41.180035 6022 raft_consensus.cc:3037] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:41.180044 5797 raft_consensus.cc:3037] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:41.180927 5797 raft_consensus.cc:2454] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a159f8e5c5b34a309ca7dee01d56f0de in term 1.
I20260812 00:00:41.181159 6131 leader_election.cc:302] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a14a5aef4584eb396187f2f729f58e2, a159f8e5c5b34a309ca7dee01d56f0de; no voters:
I20260812 00:00:41.181165 6022 raft_consensus.cc:2454] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a159f8e5c5b34a309ca7dee01d56f0de in term 1.
I20260812 00:00:41.181258 6356 raft_consensus.cc:2781] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:41.181308 6356 raft_consensus.cc:686] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [term 1 LEADER]: Becoming Leader. State: Replica: a159f8e5c5b34a309ca7dee01d56f0de, State: Running, Role: LEADER
I20260812 00:00:41.181360 6356 consensus_queue.cc:237] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.182086 5552 catalog_manager.cc:5495] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de reported cstate change: term changed from 0 to 1, leader changed from <none> to a159f8e5c5b34a309ca7dee01d56f0de (127.25.103.67). New cstate: current_term: 1 leader_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } health_report { overall_health: HEALTHY } } }
Aug 12 00:00:41 dist-test-slave-vpvm krb5kdc[5468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492840, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.126@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM
I20260812 00:00:41.216681 5631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.206947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55814 (local address 127.25.103.126:39193)
0812 00:00:41.207005 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:41.207007 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:41.207151 (+ 144us) server_negotiation.cc:407] Connection header received
0812 00:00:41.207230 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:41.207230 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:41.207240 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:41.207307 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:41.207970 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.208492 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.209677 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.209861 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.209931 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.213206 (+ 3275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:41.213208 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:41.213209 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:41.213220 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:41.215052 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:41.215819 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:41.215820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:41.215821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:41.215901 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:41.216129 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:41.216130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:41.216130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:41.216276 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:41.216332 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:41.216520 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 00:00:41.216607 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:00:41.216813 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.206837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:39193 (local address 127.0.0.1:55814)
0812 00:00:41.207066 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:41.207078 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:41.207166 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:41.207336 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:41.207337 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:41.207771 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:41.207838 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:41.207841 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.208585 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.208586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:41.209480 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:41.209493 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.210008 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.210010 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:41.210127 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.210919 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:41.210925 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:41.213012 (+ 2087us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:41.215306 (+ 2294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:41.215325 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:41.215329 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:41.215700 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:41.215980 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:41.215981 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:41.215981 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:41.216068 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:41.216342 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:41.216351 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:41.216417 (+ 66us) client_negotiation.cc:769] Sending connection context
0812 00:00:41.216491 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 00:00:41.216707 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":66,"thread_start_us":67,"threads_started":1}
I20260812 00:00:41.219380 5552 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:55814:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 00:00:41.219858 5552 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:00:41.221804 5762 tablet_service.cc:1467] Processing CreateTablet for tablet 9d41c8e67ecf4b6ab316b29d4db291f2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5f550d13b9c9408292ede9078f125285]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:00:41.222043 5762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d41c8e67ecf4b6ab316b29d4db291f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:41.221989 6205 tablet_service.cc:1467] Processing CreateTablet for tablet 9d41c8e67ecf4b6ab316b29d4db291f2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5f550d13b9c9408292ede9078f125285]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:00:41.222172 6205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d41c8e67ecf4b6ab316b29d4db291f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:41.223402 5989 tablet_service.cc:1467] Processing CreateTablet for tablet 9d41c8e67ecf4b6ab316b29d4db291f2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5f550d13b9c9408292ede9078f125285]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:00:41.223654 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d41c8e67ecf4b6ab316b29d4db291f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:41.224392 6354 tablet_bootstrap.cc:492] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2: Bootstrap starting.
I20260812 00:00:41.224903 6354 tablet_bootstrap.cc:654] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:41.226251 6354 tablet_bootstrap.cc:492] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2: No bootstrap required, opened a new log
I20260812 00:00:41.226303 6354 ts_tablet_manager.cc:1397] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:41.226468 6354 raft_consensus.cc:348] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.226547 6354 raft_consensus.cc:374] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260812 00:00:41.226475 6100 tablet.cc:2369] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:00:41.226570 6354 raft_consensus.cc:729] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a14a5aef4584eb396187f2f729f58e2, State: Initialized, Role: FOLLOWER
I20260812 00:00:41.226617 6354 consensus_queue.cc:260] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.226701 6354 ts_tablet_manager.cc:1428] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:00:41.226737 6349 tablet_bootstrap.cc:492] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de: Bootstrap starting.
I20260812 00:00:41.226852 6360 tablet_replica.cc:439] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } }
I20260812 00:00:41.226934 6360 tablet_replica.cc:442] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:41.227030 6350 tablet_bootstrap.cc:492] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9: Bootstrap starting.
I20260812 00:00:41.227166 6349 tablet_bootstrap.cc:654] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:41.227526 6350 tablet_bootstrap.cc:654] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:41.228360 6349 tablet_bootstrap.cc:492] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de: No bootstrap required, opened a new log
I20260812 00:00:41.228415 6349 ts_tablet_manager.cc:1397] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:00:41.228644 6350 tablet_bootstrap.cc:492] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9: No bootstrap required, opened a new log
I20260812 00:00:41.228698 6350 ts_tablet_manager.cc:1397] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:00:41.228709 6349 raft_consensus.cc:348] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.228806 6349 raft_consensus.cc:374] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:41.228838 6349 raft_consensus.cc:729] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a159f8e5c5b34a309ca7dee01d56f0de, State: Initialized, Role: FOLLOWER
I20260812 00:00:41.228837 6350 raft_consensus.cc:348] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.228909 6350 raft_consensus.cc:374] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:41.228883 6349 consensus_queue.cc:260] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.228940 6350 raft_consensus.cc:729] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5ca9e75804c98b8cbc6946092cae9, State: Initialized, Role: FOLLOWER
I20260812 00:00:41.228988 6349 ts_tablet_manager.cc:1428] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 00:00:41.228976 6350 consensus_queue.cc:260] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.229063 6350 ts_tablet_manager.cc:1428] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:41.229102 6356 tablet_replica.cc:439] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } }
I20260812 00:00:41.229178 6356 tablet_replica.cc:442] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:41.229317 6357 tablet_replica.cc:439] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } }
I20260812 00:00:41.229399 6357 tablet_replica.cc:442] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:41.323956 6356 raft_consensus.cc:482] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:00:41.324095 6356 raft_consensus.cc:504] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.324275 6356 leader_election.cc:288] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a14a5aef4584eb396187f2f729f58e2 (127.25.103.65:40517), aec5ca9e75804c98b8cbc6946092cae9 (127.25.103.66:42577)
I20260812 00:00:41.324501 5797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d41c8e67ecf4b6ab316b29d4db291f2" candidate_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a14a5aef4584eb396187f2f729f58e2" is_pre_election: true
I20260812 00:00:41.324522 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d41c8e67ecf4b6ab316b29d4db291f2" candidate_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5ca9e75804c98b8cbc6946092cae9" is_pre_election: true
I20260812 00:00:41.324613 5797 raft_consensus.cc:2454] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a159f8e5c5b34a309ca7dee01d56f0de in term 0.
I20260812 00:00:41.324626 6022 raft_consensus.cc:2454] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a159f8e5c5b34a309ca7dee01d56f0de in term 0.
I20260812 00:00:41.324782 6132 leader_election.cc:302] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a159f8e5c5b34a309ca7dee01d56f0de, aec5ca9e75804c98b8cbc6946092cae9; no voters:
I20260812 00:00:41.324898 6356 raft_consensus.cc:2781] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:00:41.324940 6356 raft_consensus.cc:482] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:00:41.324954 6356 raft_consensus.cc:3037] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:41.325623 6356 raft_consensus.cc:504] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.325747 6356 leader_election.cc:288] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [CANDIDATE]: Term 1 election: Requested vote from peers 0a14a5aef4584eb396187f2f729f58e2 (127.25.103.65:40517), aec5ca9e75804c98b8cbc6946092cae9 (127.25.103.66:42577)
I20260812 00:00:41.326005 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d41c8e67ecf4b6ab316b29d4db291f2" candidate_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5ca9e75804c98b8cbc6946092cae9"
I20260812 00:00:41.326092 6022 raft_consensus.cc:3037] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:41.326103 5797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d41c8e67ecf4b6ab316b29d4db291f2" candidate_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a14a5aef4584eb396187f2f729f58e2"
I20260812 00:00:41.326191 5797 raft_consensus.cc:3037] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:41.326910 5797 raft_consensus.cc:2454] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a159f8e5c5b34a309ca7dee01d56f0de in term 1.
I20260812 00:00:41.326907 6022 raft_consensus.cc:2454] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a159f8e5c5b34a309ca7dee01d56f0de in term 1.
I20260812 00:00:41.327143 6132 leader_election.cc:302] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a159f8e5c5b34a309ca7dee01d56f0de, aec5ca9e75804c98b8cbc6946092cae9; no voters:
I20260812 00:00:41.327261 6356 raft_consensus.cc:2781] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:41.327332 6356 raft_consensus.cc:686] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [term 1 LEADER]: Becoming Leader. State: Replica: a159f8e5c5b34a309ca7dee01d56f0de, State: Running, Role: LEADER
I20260812 00:00:41.327577 6356 consensus_queue.cc:237] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.328024 6367 tablet_replica.cc:439] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de: TxnStatusTablet state changed. Reason: New leader a159f8e5c5b34a309ca7dee01d56f0de. Latest consensus state: current_term: 1 leader_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } }
I20260812 00:00:41.328116 6367 tablet_replica.cc:442] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:00:41.328328 6416 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 00:00:41.328485 6416 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 00:00:41.328540 5552 catalog_manager.cc:5495] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de reported cstate change: term changed from 0 to 1, leader changed from <none> to a159f8e5c5b34a309ca7dee01d56f0de (127.25.103.67). New cstate: current_term: 1 leader_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } health_report { overall_health: HEALTHY } } }
I20260812 00:00:41.353674 6348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.350940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36632 (local address 127.25.103.67:36769)
0812 00:00:41.350991 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:41.350993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:41.351048 (+ 55us) server_negotiation.cc:407] Connection header received
0812 00:00:41.351140 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:41.351141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:41.351151 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:41.351188 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:41.351364 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.351872 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.352966 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.353157 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.353212 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.353433 (+ 221us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:41.353466 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:41.353505 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:41.353584 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 00:00:41.353608 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:00:41.353720 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.350870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:36769 (local address 127.0.0.1:36632)
0812 00:00:41.350961 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:41.350978 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:41.351071 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:41.351207 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:41.351208 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:41.351210 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:00:41.351272 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:41.351274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.351958 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.351959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:41.352865 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:41.352868 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.353226 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.353227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:41.353306 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.353331 (+ 25us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:00:41.353522 (+ 191us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:00:41.353529 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 00:00:41.353580 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:00:41.353631 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 00:00:41.354907 5797 raft_consensus.cc:1261] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2 [term 1 FOLLOWER]: Refusing update from remote peer a159f8e5c5b34a309ca7dee01d56f0de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:41.354899 6022 raft_consensus.cc:1261] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9 [term 1 FOLLOWER]: Refusing update from remote peer a159f8e5c5b34a309ca7dee01d56f0de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:41.355124 6356 consensus_queue.cc:1035] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:41.355266 6356 consensus_queue.cc:1035] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:41.355759 6357 tablet_replica.cc:439] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9: TxnStatusTablet state changed. Reason: New leader a159f8e5c5b34a309ca7dee01d56f0de. Latest consensus state: current_term: 1 leader_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } }
I20260812 00:00:41.355855 6357 tablet_replica.cc:442] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:41.355829 6360 tablet_replica.cc:439] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2: TxnStatusTablet state changed. Reason: New leader a159f8e5c5b34a309ca7dee01d56f0de. Latest consensus state: current_term: 1 leader_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } }
I20260812 00:00:41.355933 6360 tablet_replica.cc:442] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:41.357125 6357 tablet_replica.cc:439] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } }
I20260812 00:00:41.357220 6357 tablet_replica.cc:442] T 9d41c8e67ecf4b6ab316b29d4db291f2 P aec5ca9e75804c98b8cbc6946092cae9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:41.357375 6356 tablet_replica.cc:439] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } }
I20260812 00:00:41.357463 6356 tablet_replica.cc:442] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:00:41.357504 6356 tablet_replica.cc:439] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } }
I20260812 00:00:41.357539 6356 tablet_replica.cc:442] T 9d41c8e67ecf4b6ab316b29d4db291f2 P a159f8e5c5b34a309ca7dee01d56f0de: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:00:41.357631 6360 tablet_replica.cc:439] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } } }
I20260812 00:00:41.357721 6360 tablet_replica.cc:442] T 9d41c8e67ecf4b6ab316b29d4db291f2 P 0a14a5aef4584eb396187f2f729f58e2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:00:41.365283 6316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.362167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:36769 (local address 127.25.103.67:53753)
0812 00:00:41.362249 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:41.362263 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:41.362325 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:41.362507 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:41.362509 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:41.362512 (+ 3us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:00:41.362601 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:41.362603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.363593 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.363595 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:41.364200 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:41.364202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.364711 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.364713 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:41.364791 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.364816 (+ 25us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:00:41.365079 (+ 263us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:00:41.365083 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:00:41.365136 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 00:00:41.365196 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 00:00:41.365288 6348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.362217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:53753 (local address 127.25.103.67:36769)
0812 00:00:41.362264 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:41.362266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:41.362306 (+ 40us) server_negotiation.cc:407] Connection header received
0812 00:00:41.362378 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:41.362379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:41.362388 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:41.362445 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:41.362691 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.363471 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.364284 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.364584 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.364655 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.364930 (+ 275us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:41.364968 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:41.365027 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:41.365146 (+ 119us) server_negotiation.cc:299] Negotiation successful
0812 00:00:41.365167 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:00:41.367970 6022 raft_consensus.cc:1261] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9 [term 1 FOLLOWER]: Refusing update from remote peer a159f8e5c5b34a309ca7dee01d56f0de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:41.367985 5797 raft_consensus.cc:1261] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2 [term 1 FOLLOWER]: Refusing update from remote peer a159f8e5c5b34a309ca7dee01d56f0de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:41.368206 6428 consensus_queue.cc:1035] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:41.368328 6356 consensus_queue.cc:1035] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:41.381897 5551 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:41.382081 5551 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:41.382998 5551 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a: Sending DeleteTablet for 3 replicas of tablet d7a46d82c96e423bbf63a06294ba5f58
I20260812 00:00:41.383351 5762 tablet_service.cc:1514] Processing DeleteTablet for tablet d7a46d82c96e423bbf63a06294ba5f58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:41 UTC) from {username='oryx', principal='oryx/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:56406
I20260812 00:00:41.383352 6205 tablet_service.cc:1514] Processing DeleteTablet for tablet d7a46d82c96e423bbf63a06294ba5f58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:41 UTC) from {username='oryx', principal='oryx/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:36624
I20260812 00:00:41.383388 5989 tablet_service.cc:1514] Processing DeleteTablet for tablet d7a46d82c96e423bbf63a06294ba5f58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:41 UTC) from {username='oryx', principal='oryx/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:54302
I20260812 00:00:41.383466 6390 tablet_replica.cc:330] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de: stopping tablet replica
I20260812 00:00:41.383462 6392 tablet_replica.cc:330] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2: stopping tablet replica
I20260812 00:00:41.383665 6392 raft_consensus.cc:2229] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:41.383665 6390 raft_consensus.cc:2229] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:00:41.383740 6392 raft_consensus.cc:2258] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:41.383801 6390 raft_consensus.cc:2258] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:41.383855 6391 tablet_replica.cc:330] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9: stopping tablet replica
I20260812 00:00:41.383946 6391 raft_consensus.cc:2229] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:41.384001 6391 raft_consensus.cc:2258] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:41.384399 6390 ts_tablet_manager.cc:1905] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:41.384572 6391 ts_tablet_manager.cc:1905] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:41.386248 6391 ts_tablet_manager.cc:1918] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:00:41.386325 6391 log.cc:1196] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/d7a46d82c96e423bbf63a06294ba5f58
I20260812 00:00:41.386435 6392 ts_tablet_manager.cc:1905] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:41.386510 6390 ts_tablet_manager.cc:1918] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:00:41.386580 6390 log.cc:1196] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/d7a46d82c96e423bbf63a06294ba5f58
I20260812 00:00:41.386597 6391 ts_tablet_manager.cc:1939] T d7a46d82c96e423bbf63a06294ba5f58 P aec5ca9e75804c98b8cbc6946092cae9: Deleting consensus metadata
I20260812 00:00:41.387053 6390 ts_tablet_manager.cc:1939] T d7a46d82c96e423bbf63a06294ba5f58 P a159f8e5c5b34a309ca7dee01d56f0de: Deleting consensus metadata
I20260812 00:00:41.387517 5529 catalog_manager.cc:4841] TS a159f8e5c5b34a309ca7dee01d56f0de (127.25.103.67:36769): tablet d7a46d82c96e423bbf63a06294ba5f58 (table test-table [id=6ec71940b3a04061931a04a6d6f7ca4a]) successfully deleted
I20260812 00:00:41.388202 6392 ts_tablet_manager.cc:1918] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:00:41.388257 6392 log.cc:1196] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/wal/wals/d7a46d82c96e423bbf63a06294ba5f58
I20260812 00:00:41.388444 6392 ts_tablet_manager.cc:1939] T d7a46d82c96e423bbf63a06294ba5f58 P 0a14a5aef4584eb396187f2f729f58e2: Deleting consensus metadata
I20260812 00:00:41.388942 5523 catalog_manager.cc:4841] TS 0a14a5aef4584eb396187f2f729f58e2 (127.25.103.65:40517): tablet d7a46d82c96e423bbf63a06294ba5f58 (table test-table [id=6ec71940b3a04061931a04a6d6f7ca4a]) successfully deleted
I20260812 00:00:41.391242 5525 catalog_manager.cc:4841] TS aec5ca9e75804c98b8cbc6946092cae9 (127.25.103.66:42577): tablet d7a46d82c96e423bbf63a06294ba5f58 (table test-table [id=6ec71940b3a04061931a04a6d6f7ca4a]) successfully deleted
Aug 12 00:00:41 dist-test-slave-vpvm krb5kdc[5468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:00:41 dist-test-slave-vpvm krb5kdc[5468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:41 dist-test-slave-vpvm krb5kdc[5468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:00:41.415393 5631 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:41.408386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55818 (local address 127.25.103.126:39193)
0812 00:00:41.408488 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:41.408491 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:41.408629 (+ 138us) server_negotiation.cc:407] Connection header received
0812 00:00:41.408736 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:41.408738 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:41.408754 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:41.408828 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:41.409519 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.410338 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.411323 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.411630 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.411716 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.415298 (+ 3582us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55818: BlockingRecv error: recv got EOF from 127.0.0.1:55818 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 12 00:00:41 dist-test-slave-vpvm krb5kdc[5468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM
I20260812 00:00:41.426396 5631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.416529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55832 (local address 127.25.103.126:39193)
0812 00:00:41.416578 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:41.416580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:41.416641 (+ 61us) server_negotiation.cc:407] Connection header received
0812 00:00:41.416721 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:41.416722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:41.416730 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:41.416778 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:41.417474 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.418167 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.419336 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.419559 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.419634 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.423081 (+ 3447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:41.423082 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:41.423082 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:41.423093 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:41.424704 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:41.425301 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:41.425303 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:41.425304 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:41.425379 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:41.425619 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:41.425620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:41.425620 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:41.425763 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:41.425851 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:41.426181 (+ 330us) server_negotiation.cc:299] Negotiation successful
0812 00:00:41.426295 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:00:41.428340 5551 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55832:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:00:41.428540 5551 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:00:41.430531 5762 tablet_service.cc:1467] Processing CreateTablet for tablet 968acfebfcf14adeb6c24de4275e6583 (DEFAULT_TABLE table=test-table [id=44e5e79776f0410883cb90660a740fdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:41.430531 5989 tablet_service.cc:1467] Processing CreateTablet for tablet 968acfebfcf14adeb6c24de4275e6583 (DEFAULT_TABLE table=test-table [id=44e5e79776f0410883cb90660a740fdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:41.430714 5762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 968acfebfcf14adeb6c24de4275e6583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:41.430714 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 968acfebfcf14adeb6c24de4275e6583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:41.432193 6350 tablet_bootstrap.cc:492] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9: Bootstrap starting.
I20260812 00:00:41.432261 6205 tablet_service.cc:1467] Processing CreateTablet for tablet 968acfebfcf14adeb6c24de4275e6583 (DEFAULT_TABLE table=test-table [id=44e5e79776f0410883cb90660a740fdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:41.432389 6205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 968acfebfcf14adeb6c24de4275e6583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:41.432617 6350 tablet_bootstrap.cc:654] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:41.432965 6354 tablet_bootstrap.cc:492] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2: Bootstrap starting.
I20260812 00:00:41.433382 6354 tablet_bootstrap.cc:654] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:41.433820 6349 tablet_bootstrap.cc:492] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de: Bootstrap starting.
I20260812 00:00:41.434165 6349 tablet_bootstrap.cc:654] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:41.434357 6350 tablet_bootstrap.cc:492] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9: No bootstrap required, opened a new log
I20260812 00:00:41.434422 6350 ts_tablet_manager.cc:1397] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:00:41.434603 6350 raft_consensus.cc:348] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.434697 6350 raft_consensus.cc:374] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:41.434705 6354 tablet_bootstrap.cc:492] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2: No bootstrap required, opened a new log
I20260812 00:00:41.434729 6350 raft_consensus.cc:729] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5ca9e75804c98b8cbc6946092cae9, State: Initialized, Role: FOLLOWER
I20260812 00:00:41.434743 6354 ts_tablet_manager.cc:1397] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:41.434773 6350 consensus_queue.cc:260] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.434865 6350 ts_tablet_manager.cc:1428] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 00:00:41.434888 6354 raft_consensus.cc:348] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.434952 6354 raft_consensus.cc:374] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:41.434981 6354 raft_consensus.cc:729] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a14a5aef4584eb396187f2f729f58e2, State: Initialized, Role: FOLLOWER
I20260812 00:00:41.435019 6354 consensus_queue.cc:260] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.435111 6354 ts_tablet_manager.cc:1428] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:00:41.435490 6349 tablet_bootstrap.cc:492] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de: No bootstrap required, opened a new log
I20260812 00:00:41.435554 6349 ts_tablet_manager.cc:1397] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:41.435664 6349 raft_consensus.cc:348] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.435739 6349 raft_consensus.cc:374] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:41.435756 6349 raft_consensus.cc:729] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a159f8e5c5b34a309ca7dee01d56f0de, State: Initialized, Role: FOLLOWER
I20260812 00:00:41.435806 6349 consensus_queue.cc:260] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.435889 6349 ts_tablet_manager.cc:1428] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:00:41.558563 6357 raft_consensus.cc:482] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:00:41.558724 6357 raft_consensus.cc:504] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.559197 6357 leader_election.cc:288] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a14a5aef4584eb396187f2f729f58e2 (127.25.103.65:40517), a159f8e5c5b34a309ca7dee01d56f0de (127.25.103.67:36769)
I20260812 00:00:41.564251 6348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.559540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:45685 (local address 127.25.103.67:36769)
0812 00:00:41.559618 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:41.559621 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:41.559715 (+ 94us) server_negotiation.cc:407] Connection header received
0812 00:00:41.559778 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:41.559779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:41.559789 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:41.559860 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:41.560344 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.561220 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.563168 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.563735 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.563810 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.563821 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:41.564107 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 00:00:41.564155 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:00:41.564251 6347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.559621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:44795 (local address 127.25.103.65:40517)
0812 00:00:41.559675 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:41.559677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:41.559693 (+ 16us) server_negotiation.cc:407] Connection header received
0812 00:00:41.559778 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:41.559779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:41.559789 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:41.559874 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:00:41.560349 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.561220 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.563047 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.563660 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.563782 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.563794 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:41.564111 (+ 317us) server_negotiation.cc:299] Negotiation successful
0812 00:00:41.564156 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:00:41.564311 6460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.559437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:36769 (local address 127.25.103.66:45685)
0812 00:00:41.559624 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:41.559632 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:41.559712 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:41.559966 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:41.559969 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:41.559975 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:41.560151 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:41.560155 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.561345 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.561346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:41.563043 (+ 1697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:41.563045 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.563886 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.563887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:41.563999 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.564010 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:00:41.564086 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 00:00:41.564161 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":62,"thread_start_us":95,"threads_started":1}
I20260812 00:00:41.564524 6459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.559438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:40517 (local address 127.25.103.66:44795)
0812 00:00:41.559618 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:41.559631 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:41.559712 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:41.559966 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:41.559969 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:41.559975 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:00:41.560151 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:41.560154 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.561344 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.561346 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:41.562889 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:41.562895 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.563886 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.563887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:41.563999 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.564013 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 00:00:41.564086 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 00:00:41.564161 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":19,"thread_start_us":117,"threads_started":1}
I20260812 00:00:41.564705 6234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "968acfebfcf14adeb6c24de4275e6583" candidate_uuid: "aec5ca9e75804c98b8cbc6946092cae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" is_pre_election: true
I20260812 00:00:41.564903 6234 raft_consensus.cc:2454] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aec5ca9e75804c98b8cbc6946092cae9 in term 0.
I20260812 00:00:41.564841 5797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "968acfebfcf14adeb6c24de4275e6583" candidate_uuid: "aec5ca9e75804c98b8cbc6946092cae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a14a5aef4584eb396187f2f729f58e2" is_pre_election: true
I20260812 00:00:41.564972 5797 raft_consensus.cc:2454] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aec5ca9e75804c98b8cbc6946092cae9 in term 0.
I20260812 00:00:41.565183 5918 leader_election.cc:302] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a159f8e5c5b34a309ca7dee01d56f0de, aec5ca9e75804c98b8cbc6946092cae9; no voters:
I20260812 00:00:41.565387 6357 raft_consensus.cc:2781] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:00:41.565501 6357 raft_consensus.cc:482] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:00:41.565518 6357 raft_consensus.cc:3037] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:41.566323 6357 raft_consensus.cc:504] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.566501 6357 leader_election.cc:288] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [CANDIDATE]: Term 1 election: Requested vote from peers 0a14a5aef4584eb396187f2f729f58e2 (127.25.103.65:40517), a159f8e5c5b34a309ca7dee01d56f0de (127.25.103.67:36769)
I20260812 00:00:41.566711 5797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "968acfebfcf14adeb6c24de4275e6583" candidate_uuid: "aec5ca9e75804c98b8cbc6946092cae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a14a5aef4584eb396187f2f729f58e2"
I20260812 00:00:41.566824 5797 raft_consensus.cc:3037] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:41.566857 6234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "968acfebfcf14adeb6c24de4275e6583" candidate_uuid: "aec5ca9e75804c98b8cbc6946092cae9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a159f8e5c5b34a309ca7dee01d56f0de"
I20260812 00:00:41.566983 6234 raft_consensus.cc:3037] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:41.568080 6234 raft_consensus.cc:2454] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5ca9e75804c98b8cbc6946092cae9 in term 1.
I20260812 00:00:41.568075 5797 raft_consensus.cc:2454] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5ca9e75804c98b8cbc6946092cae9 in term 1.
I20260812 00:00:41.568343 5918 leader_election.cc:302] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a159f8e5c5b34a309ca7dee01d56f0de, aec5ca9e75804c98b8cbc6946092cae9; no voters:
I20260812 00:00:41.568473 6357 raft_consensus.cc:2781] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:41.568622 6357 raft_consensus.cc:686] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [term 1 LEADER]: Becoming Leader. State: Replica: aec5ca9e75804c98b8cbc6946092cae9, State: Running, Role: LEADER
I20260812 00:00:41.568686 6357 consensus_queue.cc:237] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.569497 5551 catalog_manager.cc:5495] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 reported cstate change: term changed from 0 to 1, leader changed from <none> to aec5ca9e75804c98b8cbc6946092cae9 (127.25.103.66). New cstate: current_term: 1 leader_uuid: "aec5ca9e75804c98b8cbc6946092cae9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } health_report { overall_health: UNKNOWN } } }
I20260812 00:00:41.584510 6345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.581501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54310 (local address 127.25.103.66:42577)
0812 00:00:41.581609 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:41.581616 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:41.581626 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:00:41.581669 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:41.581670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:41.581692 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:41.581778 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:41.582030 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.582538 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.583372 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.583637 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.583743 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.583978 (+ 235us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:41.584114 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:41.584194 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:41.584357 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 00:00:41.584396 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 00:00:41.586377 5797 raft_consensus.cc:1261] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2 [term 1 FOLLOWER]: Refusing update from remote peer aec5ca9e75804c98b8cbc6946092cae9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:41.586404 6234 raft_consensus.cc:1261] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de [term 1 FOLLOWER]: Refusing update from remote peer aec5ca9e75804c98b8cbc6946092cae9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:41.586826 6464 consensus_queue.cc:1035] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:41.587054 6357 consensus_queue.cc:1035] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:41.591022 5551 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:41.591137 5551 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:41.591814 5551 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a: Sending DeleteTablet for 3 replicas of tablet 968acfebfcf14adeb6c24de4275e6583
I20260812 00:00:41.592123 5762 tablet_service.cc:1514] Processing DeleteTablet for tablet 968acfebfcf14adeb6c24de4275e6583 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:41 UTC) from {username='oryx', principal='oryx/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:56406
I20260812 00:00:41.592166 6205 tablet_service.cc:1514] Processing DeleteTablet for tablet 968acfebfcf14adeb6c24de4275e6583 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:41 UTC) from {username='oryx', principal='oryx/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:36624
I20260812 00:00:41.592231 6392 tablet_replica.cc:330] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2: stopping tablet replica
I20260812 00:00:41.592296 6392 raft_consensus.cc:2229] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:41.592267 6390 tablet_replica.cc:330] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de: stopping tablet replica
I20260812 00:00:41.592361 6392 raft_consensus.cc:2258] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:41.592370 6390 raft_consensus.cc:2229] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:41.592435 6390 raft_consensus.cc:2258] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:41.592595 5989 tablet_service.cc:1514] Processing DeleteTablet for tablet 968acfebfcf14adeb6c24de4275e6583 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:41 UTC) from {username='oryx', principal='oryx/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:54302
I20260812 00:00:41.592687 6391 tablet_replica.cc:330] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9: stopping tablet replica
I20260812 00:00:41.592731 6391 raft_consensus.cc:2229] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:00:41.592758 6392 ts_tablet_manager.cc:1905] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:41.592823 6391 raft_consensus.cc:2258] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:41.592842 6390 ts_tablet_manager.cc:1905] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:41.593348 6391 ts_tablet_manager.cc:1905] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:41.594475 6392 ts_tablet_manager.cc:1918] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:00:41.594530 6392 log.cc:1196] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-0/wal/wals/968acfebfcf14adeb6c24de4275e6583
I20260812 00:00:41.594561 6390 ts_tablet_manager.cc:1918] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:00:41.594620 6390 log.cc:1196] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/968acfebfcf14adeb6c24de4275e6583
I20260812 00:00:41.594746 6392 ts_tablet_manager.cc:1939] T 968acfebfcf14adeb6c24de4275e6583 P 0a14a5aef4584eb396187f2f729f58e2: Deleting consensus metadata
I20260812 00:00:41.594844 6390 ts_tablet_manager.cc:1939] T 968acfebfcf14adeb6c24de4275e6583 P a159f8e5c5b34a309ca7dee01d56f0de: Deleting consensus metadata
I20260812 00:00:41.594841 6391 ts_tablet_manager.cc:1918] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:00:41.594887 6391 log.cc:1196] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/968acfebfcf14adeb6c24de4275e6583
I20260812 00:00:41.595067 6391 ts_tablet_manager.cc:1939] T 968acfebfcf14adeb6c24de4275e6583 P aec5ca9e75804c98b8cbc6946092cae9: Deleting consensus metadata
I20260812 00:00:41.595233 5523 catalog_manager.cc:4841] TS 0a14a5aef4584eb396187f2f729f58e2 (127.25.103.65:40517): tablet 968acfebfcf14adeb6c24de4275e6583 (table test-table [id=44e5e79776f0410883cb90660a740fdf]) successfully deleted
I20260812 00:00:41.595239 5529 catalog_manager.cc:4841] TS a159f8e5c5b34a309ca7dee01d56f0de (127.25.103.67:36769): tablet 968acfebfcf14adeb6c24de4275e6583 (table test-table [id=44e5e79776f0410883cb90660a740fdf]) successfully deleted
I20260812 00:00:41.595496 5551 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55832:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 00:00:41.595618 5525 catalog_manager.cc:4841] TS aec5ca9e75804c98b8cbc6946092cae9 (127.25.103.66:42577): tablet 968acfebfcf14adeb6c24de4275e6583 (table test-table [id=44e5e79776f0410883cb90660a740fdf]) successfully deleted
W20260812 00:00:41.595665 5551 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:00:41.596953 5762 tablet_service.cc:1467] Processing CreateTablet for tablet e825f221e702418e95c624b9a4f87abd (DEFAULT_TABLE table=test-table [id=1dc82c09ac6b421c92641db45fe76cd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:41.597048 6205 tablet_service.cc:1467] Processing CreateTablet for tablet e825f221e702418e95c624b9a4f87abd (DEFAULT_TABLE table=test-table [id=1dc82c09ac6b421c92641db45fe76cd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:41.597086 5762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e825f221e702418e95c624b9a4f87abd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:41.597095 5989 tablet_service.cc:1467] Processing CreateTablet for tablet e825f221e702418e95c624b9a4f87abd (DEFAULT_TABLE table=test-table [id=1dc82c09ac6b421c92641db45fe76cd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:00:41.597144 6205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e825f221e702418e95c624b9a4f87abd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:41.597236 5989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e825f221e702418e95c624b9a4f87abd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:41.598480 6349 tablet_bootstrap.cc:492] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de: Bootstrap starting.
I20260812 00:00:41.598626 6350 tablet_bootstrap.cc:492] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9: Bootstrap starting.
I20260812 00:00:41.598815 6349 tablet_bootstrap.cc:654] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:41.599036 6350 tablet_bootstrap.cc:654] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:41.599073 6354 tablet_bootstrap.cc:492] T e825f221e702418e95c624b9a4f87abd P 0a14a5aef4584eb396187f2f729f58e2: Bootstrap starting.
I20260812 00:00:41.599494 6354 tablet_bootstrap.cc:654] T e825f221e702418e95c624b9a4f87abd P 0a14a5aef4584eb396187f2f729f58e2: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:41.599759 6350 tablet_bootstrap.cc:492] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9: No bootstrap required, opened a new log
I20260812 00:00:41.599822 6350 ts_tablet_manager.cc:1397] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 00:00:41.600004 6350 raft_consensus.cc:348] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.600088 6350 raft_consensus.cc:374] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:41.600108 6350 raft_consensus.cc:729] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5ca9e75804c98b8cbc6946092cae9, State: Initialized, Role: FOLLOWER
I20260812 00:00:41.600158 6350 consensus_queue.cc:260] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.600193 6349 tablet_bootstrap.cc:492] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de: No bootstrap required, opened a new log
I20260812 00:00:41.600236 6349 ts_tablet_manager.cc:1397] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:41.600255 6350 ts_tablet_manager.cc:1428] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 00:00:41.600345 6349 raft_consensus.cc:348] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.600427 6349 raft_consensus.cc:374] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:41.600446 6349 raft_consensus.cc:729] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a159f8e5c5b34a309ca7dee01d56f0de, State: Initialized, Role: FOLLOWER
I20260812 00:00:41.600487 6349 consensus_queue.cc:260] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.600576 6349 ts_tablet_manager.cc:1428] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:41.600970 6354 tablet_bootstrap.cc:492] T e825f221e702418e95c624b9a4f87abd P 0a14a5aef4584eb396187f2f729f58e2: No bootstrap required, opened a new log
I20260812 00:00:41.601018 6354 ts_tablet_manager.cc:1397] T e825f221e702418e95c624b9a4f87abd P 0a14a5aef4584eb396187f2f729f58e2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:00:41.601174 6354 raft_consensus.cc:348] T e825f221e702418e95c624b9a4f87abd P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.601256 6354 raft_consensus.cc:374] T e825f221e702418e95c624b9a4f87abd P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:41.601275 6354 raft_consensus.cc:729] T e825f221e702418e95c624b9a4f87abd P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a14a5aef4584eb396187f2f729f58e2, State: Initialized, Role: FOLLOWER
I20260812 00:00:41.601318 6354 consensus_queue.cc:260] T e825f221e702418e95c624b9a4f87abd P 0a14a5aef4584eb396187f2f729f58e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.601418 6354 ts_tablet_manager.cc:1428] T e825f221e702418e95c624b9a4f87abd P 0a14a5aef4584eb396187f2f729f58e2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:00:41.642088 6432 raft_consensus.cc:482] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:00:41.642231 6432 raft_consensus.cc:504] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.642416 6432 leader_election.cc:288] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a14a5aef4584eb396187f2f729f58e2 (127.25.103.65:40517), aec5ca9e75804c98b8cbc6946092cae9 (127.25.103.66:42577)
I20260812 00:00:41.642835 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e825f221e702418e95c624b9a4f87abd" candidate_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5ca9e75804c98b8cbc6946092cae9" is_pre_election: true
I20260812 00:00:41.642832 5797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e825f221e702418e95c624b9a4f87abd" candidate_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a14a5aef4584eb396187f2f729f58e2" is_pre_election: true
I20260812 00:00:41.642976 6022 raft_consensus.cc:2454] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a159f8e5c5b34a309ca7dee01d56f0de in term 0.
I20260812 00:00:41.643016 5797 raft_consensus.cc:2454] T e825f221e702418e95c624b9a4f87abd P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a159f8e5c5b34a309ca7dee01d56f0de in term 0.
I20260812 00:00:41.643239 6131 leader_election.cc:302] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a14a5aef4584eb396187f2f729f58e2, a159f8e5c5b34a309ca7dee01d56f0de; no voters:
I20260812 00:00:41.643419 6432 raft_consensus.cc:2781] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:00:41.643467 6432 raft_consensus.cc:482] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:00:41.643488 6432 raft_consensus.cc:3037] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:41.644500 6432 raft_consensus.cc:504] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.644652 6432 leader_election.cc:288] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [CANDIDATE]: Term 1 election: Requested vote from peers 0a14a5aef4584eb396187f2f729f58e2 (127.25.103.65:40517), aec5ca9e75804c98b8cbc6946092cae9 (127.25.103.66:42577)
I20260812 00:00:41.644891 5797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e825f221e702418e95c624b9a4f87abd" candidate_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a14a5aef4584eb396187f2f729f58e2"
I20260812 00:00:41.644907 6022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e825f221e702418e95c624b9a4f87abd" candidate_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5ca9e75804c98b8cbc6946092cae9"
I20260812 00:00:41.644989 5797 raft_consensus.cc:3037] T e825f221e702418e95c624b9a4f87abd P 0a14a5aef4584eb396187f2f729f58e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:41.644995 6022 raft_consensus.cc:3037] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:41.645896 6022 raft_consensus.cc:2454] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a159f8e5c5b34a309ca7dee01d56f0de in term 1.
I20260812 00:00:41.645896 5797 raft_consensus.cc:2454] T e825f221e702418e95c624b9a4f87abd P 0a14a5aef4584eb396187f2f729f58e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a159f8e5c5b34a309ca7dee01d56f0de in term 1.
I20260812 00:00:41.646128 6132 leader_election.cc:302] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a159f8e5c5b34a309ca7dee01d56f0de, aec5ca9e75804c98b8cbc6946092cae9; no voters:
I20260812 00:00:41.646270 6432 raft_consensus.cc:2781] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:41.646505 6432 raft_consensus.cc:686] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [term 1 LEADER]: Becoming Leader. State: Replica: a159f8e5c5b34a309ca7dee01d56f0de, State: Running, Role: LEADER
I20260812 00:00:41.646612 6432 consensus_queue.cc:237] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } }
I20260812 00:00:41.647622 5551 catalog_manager.cc:5495] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de reported cstate change: term changed from 0 to 1, leader changed from <none> to a159f8e5c5b34a309ca7dee01d56f0de (127.25.103.67). New cstate: current_term: 1 leader_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a159f8e5c5b34a309ca7dee01d56f0de" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36769 } health_report { overall_health: HEALTHY } } }
I20260812 00:00:41.668823 6348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.665981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36642 (local address 127.25.103.67:36769)
0812 00:00:41.666034 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:41.666036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:41.666095 (+ 59us) server_negotiation.cc:407] Connection header received
0812 00:00:41.666176 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:41.666177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:41.666189 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:41.666260 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:00:41.666501 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.667250 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.668146 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:41.668362 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:41.668427 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:41.668572 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:00:41.668611 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:00:41.668652 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:41.668715 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 00:00:41.668737 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:00:41.672181 5797 raft_consensus.cc:1261] T e825f221e702418e95c624b9a4f87abd P 0a14a5aef4584eb396187f2f729f58e2 [term 1 FOLLOWER]: Refusing update from remote peer a159f8e5c5b34a309ca7dee01d56f0de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:41.672345 6022 raft_consensus.cc:1261] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9 [term 1 FOLLOWER]: Refusing update from remote peer a159f8e5c5b34a309ca7dee01d56f0de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:00:41.672650 6432 consensus_queue.cc:1035] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a14a5aef4584eb396187f2f729f58e2" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:41.672837 6432 consensus_queue.cc:1035] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5ca9e75804c98b8cbc6946092cae9" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 42577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:00:41.686866 5551 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:41.686986 5551 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:00:41.687784 5551 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 71ce7f4a057d440082b4f8a89a7b968a: Sending DeleteTablet for 3 replicas of tablet e825f221e702418e95c624b9a4f87abd
I20260812 00:00:41.688094 5762 tablet_service.cc:1514] Processing DeleteTablet for tablet e825f221e702418e95c624b9a4f87abd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:41 UTC) from {username='oryx', principal='oryx/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:56406
I20260812 00:00:41.688128 5989 tablet_service.cc:1514] Processing DeleteTablet for tablet e825f221e702418e95c624b9a4f87abd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:41 UTC) from {username='oryx', principal='oryx/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:54302
I20260812 00:00:41.688212 6391 tablet_replica.cc:330] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9: stopping tablet replica
I20260812 00:00:41.688213 6392 tablet_replica.cc:330] T e825f221e702418e95c624b9a4f87abd P 0a14a5aef4584eb396187f2f729f58e2: stopping tablet replica
I20260812 00:00:41.688259 6392 raft_consensus.cc:2229] T e825f221e702418e95c624b9a4f87abd P 0a14a5aef4584eb396187f2f729f58e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:41.688262 6391 raft_consensus.cc:2229] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:00:41.688302 6391 raft_consensus.cc:2258] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:41.688303 6392 raft_consensus.cc:2258] T e825f221e702418e95c624b9a4f87abd P 0a14a5aef4584eb396187f2f729f58e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:41.688391 6205 tablet_service.cc:1514] Processing DeleteTablet for tablet e825f221e702418e95c624b9a4f87abd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:00:41 UTC) from {username='oryx', principal='oryx/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:36624
I20260812 00:00:41.688545 6390 tablet_replica.cc:330] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de: stopping tablet replica
I20260812 00:00:41.688627 6390 raft_consensus.cc:2229] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:00:41.688700 6390 raft_consensus.cc:2258] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:00:41.688687 6392 ts_tablet_manager.cc:1905] T e825f221e702418e95c624b9a4f87abd P 0a14a5aef4584eb396187f2f729f58e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:41.689060 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 5666
I20260812 00:00:41.689158 6390 ts_tablet_manager.cc:1905] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:41.710457 6391 ts_tablet_manager.cc:1905] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:00:41.713675 6391 ts_tablet_manager.cc:1918] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:00:41.713755 6391 log.cc:1196] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/e825f221e702418e95c624b9a4f87abd
I20260812 00:00:41.713925 6391 ts_tablet_manager.cc:1939] T e825f221e702418e95c624b9a4f87abd P aec5ca9e75804c98b8cbc6946092cae9: Deleting consensus metadata
I20260812 00:00:41.714537 5525 catalog_manager.cc:4841] TS aec5ca9e75804c98b8cbc6946092cae9 (127.25.103.66:42577): tablet e825f221e702418e95c624b9a4f87abd (table test-table [id=1dc82c09ac6b421c92641db45fe76cd5]) successfully deleted
I20260812 00:00:41.719636 6390 ts_tablet_manager.cc:1918] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:00:41.719775 6390 log.cc:1196] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/e825f221e702418e95c624b9a4f87abd
I20260812 00:00:41.720024 6390 ts_tablet_manager.cc:1939] T e825f221e702418e95c624b9a4f87abd P a159f8e5c5b34a309ca7dee01d56f0de: Deleting consensus metadata
W20260812 00:00:41.720446 5523 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.103.65:40517 (error 108)
I20260812 00:00:41.720508 5529 catalog_manager.cc:4841] TS a159f8e5c5b34a309ca7dee01d56f0de (127.25.103.67:36769): tablet e825f221e702418e95c624b9a4f87abd (table test-table [id=1dc82c09ac6b421c92641db45fe76cd5]) successfully deleted
I20260812 00:00:41.721252 6485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.720956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:40517 (local address 127.0.0.1:56416)
0812 00:00:41.721126 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:41.721201 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:40517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":77,"threads_started":1}
I20260812 00:00:41.721366 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 5884
W20260812 00:00:41.721390 5523 catalog_manager.cc:4584] TS 0a14a5aef4584eb396187f2f729f58e2 (127.25.103.65:40517): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e825f221e702418e95c624b9a4f87abd: Network error: Client connection negotiation failed: client connection to 127.25.103.65:40517: connect: Connection refused (error 111)
I20260812 00:00:41.745760 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 6109
I20260812 00:00:41.783674 6485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.779671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:40517 (local address 127.0.0.1:56426)
0812 00:00:41.783548 (+ 3877us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:41.783618 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:40517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3835}
I20260812 00:00:41.820240 6485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:41.819993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:40517 (local address 127.0.0.1:56440)
0812 00:00:41.820145 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:41.820182 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:40517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
I20260812 00:00:41.826733 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 5489
2026-08-12T00:00:41Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3101 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:00:41 dist-test-slave-vpvm krb5kdc[6491](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:00:41 dist-test-slave-vpvm krb5kdc[6491](info): set up 2 sockets
Aug 12 00:00:41 dist-test-slave-vpvm krb5kdc[6491](info): commencing operation
krb5kdc: starting...
W20260812 00:00:43.062047 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.192s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:00:43 dist-test-slave-vpvm krb5kdc[6491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492843, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:00:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:00:43.196421 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:37807
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:45099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:37807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:43.286831 6514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:43.287063 6514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:43.287096 6514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:43.288265 6514 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:43.288311 6514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:43.288329 6514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:43.288347 6514 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:43.288362 6514 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:00:43.289887 6514 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:45099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:37807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:37807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:43.290174 6514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:43.290400 6514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:43.295740 6527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:43.295833 6514 server_base.cc:1034] running on GCE node
W20260812 00:00:43.295737 6524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:43.295740 6522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:43.296280 6514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:43.296713 6514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:43.297889 6514 hybrid_clock.cc:648] HybridClock initialized: now 1786492843297877 us; error 30 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T00:00:43Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1462 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:00:43 dist-test-slave-vpvm krb5kdc[6534](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:00:43 dist-test-slave-vpvm krb5kdc[6534](info): set up 2 sockets
Aug 12 00:00:43 dist-test-slave-vpvm krb5kdc[6534](info): commencing operation
krb5kdc: starting...
W20260812 00:00:44.573154 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:00:44 dist-test-slave-vpvm krb5kdc[6534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:00:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:00:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:00:44.700269 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:35039
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:38823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:35039
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:44.785441 6553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:44.785676 6553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:44.785710 6553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:44.786921 6553 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:44.786970 6553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:44.786989 6553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:44.787005 6553 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:44.787022 6553 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:00:44.788570 6553 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:38823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:35039
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:35039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:44.788851 6553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:44.789083 6553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:44.794124 6566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:44.794099 6561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:44.794250 6553 server_base.cc:1034] running on GCE node
W20260812 00:00:44.794124 6559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:44.794658 6553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:44.795001 6553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:44.796159 6553 hybrid_clock.cc:648] HybridClock initialized: now 1786492844796142 us; error 42 us; skew 500 ppm
Aug 12 00:00:44 dist-test-slave-vpvm krb5kdc[6534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492844, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:44.798951 6553 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:00:44.799429 6553 webserver.cc:460] Webserver started at http://127.25.103.126:37917/ using document root <none> and password file <none>
I20260812 00:00:44.799657 6553 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:44.799707 6553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:44.799836 6553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:44.800908 6553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "a83fc220418f4139896b2869fc5e3410"
format_stamp: "Formatted at 2026-08-12 00:00:44 on dist-test-slave-vpvm"
server_key: "deda8d3cf03c3b69df22b86fe0eaf8da"
server_key_iv: "691427c3993766d0b7e421cf5c304477"
server_key_version: "encryptionkey@0"
I20260812 00:00:44.801260 6553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "a83fc220418f4139896b2869fc5e3410"
format_stamp: "Formatted at 2026-08-12 00:00:44 on dist-test-slave-vpvm"
server_key: "deda8d3cf03c3b69df22b86fe0eaf8da"
server_key_iv: "691427c3993766d0b7e421cf5c304477"
server_key_version: "encryptionkey@0"
I20260812 00:00:44.802701 6553 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:00:44.803689 6579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:44.803967 6553 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:00:44.804077 6553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "a83fc220418f4139896b2869fc5e3410"
format_stamp: "Formatted at 2026-08-12 00:00:44 on dist-test-slave-vpvm"
server_key: "deda8d3cf03c3b69df22b86fe0eaf8da"
server_key_iv: "691427c3993766d0b7e421cf5c304477"
server_key_version: "encryptionkey@0"
I20260812 00:00:44.804143 6553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:44.812163 6553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:44.814379 6553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:44.814527 6553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:44.818969 6553 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:35039
I20260812 00:00:44.819061 6650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:35039 every 8 connection(s)
I20260812 00:00:44.819391 6553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:44.820425 6651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:00:44.824406 6651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410: Bootstrap starting.
I20260812 00:00:44.825248 6651 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410: Neither blocks nor log segments found. Creating new log.
I20260812 00:00:44.825659 6651 log.cc:824] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:44.826609 6651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410: No bootstrap required, opened a new log
I20260812 00:00:44.827911 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 6553
I20260812 00:00:44.828009 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:00:44.828166 26013 external_mini_cluster.cc:1428] Setting key f4f0a716da161143f5089245cac0d2f0
I20260812 00:00:44.828320 6651 raft_consensus.cc:348] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a83fc220418f4139896b2869fc5e3410" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35039 } }
I20260812 00:00:44.828475 6651 raft_consensus.cc:374] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:00:44.828529 6651 raft_consensus.cc:729] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83fc220418f4139896b2869fc5e3410, State: Initialized, Role: FOLLOWER
I20260812 00:00:44.828677 6651 consensus_queue.cc:260] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a83fc220418f4139896b2869fc5e3410" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35039 } }
I20260812 00:00:44.828773 6651 raft_consensus.cc:388] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:44.828805 6651 raft_consensus.cc:482] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:44.828856 6651 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:00:44.829936 6651 raft_consensus.cc:504] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a83fc220418f4139896b2869fc5e3410" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35039 } }
I20260812 00:00:44.830068 6651 leader_election.cc:302] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a83fc220418f4139896b2869fc5e3410; no voters:
I20260812 00:00:44.830225 6651 leader_election.cc:288] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:00:44.830348 6661 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:00:44.830513 6661 raft_consensus.cc:686] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [term 1 LEADER]: Becoming Leader. State: Replica: a83fc220418f4139896b2869fc5e3410, State: Running, Role: LEADER
I20260812 00:00:44.830523 6651 sys_catalog.cc:564] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:44.830624 6661 consensus_queue.cc:237] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a83fc220418f4139896b2869fc5e3410" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35039 } }
I20260812 00:00:44.830989 6664 sys_catalog.cc:455] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a83fc220418f4139896b2869fc5e3410" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a83fc220418f4139896b2869fc5e3410" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35039 } } }
I20260812 00:00:44.831079 6664 sys_catalog.cc:458] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:44.831244 6667 sys_catalog.cc:455] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a83fc220418f4139896b2869fc5e3410. Latest consensus state: current_term: 1 leader_uuid: "a83fc220418f4139896b2869fc5e3410" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a83fc220418f4139896b2869fc5e3410" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35039 } } }
I20260812 00:00:44.831317 6667 sys_catalog.cc:458] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:44.831449 6680 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:44.831977 6680 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:00:44.833814 6680 catalog_manager.cc:1347] Generated new cluster ID: ea4771d632e5431e8a55036410e89589
I20260812 00:00:44.833916 6680 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:00:44 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:44.840170 6660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:44.828663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59946 (local address 127.25.103.126:35039)
0812 00:00:44.828873 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:44.828883 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:44.828916 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:00:44.829065 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:44.829073 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:44.829128 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:44.829295 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:44.829913 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:44.831310 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:44.832559 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:44.833150 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:44.833253 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:44.836045 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:44.836049 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:44.836049 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:44.836061 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:44.838147 (+ 2086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:44.838591 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:44.838598 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:44.838599 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:44.838724 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:44.838923 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:44.838923 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:44.838924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:44.839225 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:44.839371 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:44.839801 (+ 430us) server_negotiation.cc:299] Negotiation successful
0812 00:00:44.839947 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":89,"threads_started":1}
I20260812 00:00:44.841486 6680 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:00:44.842025 6680 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:44.846931 6680 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410: Generated new TSK 0
I20260812 00:00:44.847185 6680 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
I20260812 00:00:44.885095 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:35039
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:38823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:45.009357 6700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:45.009589 6700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:45.009617 6700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:45.010885 6700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:45.010934 6700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:45.010967 6700 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:00:45.012470 6700 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:38823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:35039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6700
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:45.012696 6700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:45.012890 6700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:45.018178 6714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:45.018244 6700 server_base.cc:1034] running on GCE node
W20260812 00:00:45.018412 6707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:45.018445 6709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:45.018699 6700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:45.018944 6700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:45.020108 6700 hybrid_clock.cc:648] HybridClock initialized: now 1786492845020085 us; error 38 us; skew 500 ppm
Aug 12 00:00:45 dist-test-slave-vpvm krb5kdc[6534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492845, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:45.022933 6700 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:00:45.023389 6700 webserver.cc:460] Webserver started at http://127.25.103.65:37989/ using document root <none> and password file <none>
I20260812 00:00:45.023625 6700 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:45.023677 6700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:45.023815 6700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:45.024896 6700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "9f84d1c41c2d4e31bd64a640bfa72a42"
format_stamp: "Formatted at 2026-08-12 00:00:45 on dist-test-slave-vpvm"
server_key: "baf05c0523ad0ecb411fc54f5ea6939c"
server_key_iv: "42655b369ed7424c9e0ca0d6bd629271"
server_key_version: "encryptionkey@0"
I20260812 00:00:45.025238 6700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "9f84d1c41c2d4e31bd64a640bfa72a42"
format_stamp: "Formatted at 2026-08-12 00:00:45 on dist-test-slave-vpvm"
server_key: "baf05c0523ad0ecb411fc54f5ea6939c"
server_key_iv: "42655b369ed7424c9e0ca0d6bd629271"
server_key_version: "encryptionkey@0"
I20260812 00:00:45.026880 6700 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 00:00:45.027737 6725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:45.028043 6700 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:45.028137 6700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "9f84d1c41c2d4e31bd64a640bfa72a42"
format_stamp: "Formatted at 2026-08-12 00:00:45 on dist-test-slave-vpvm"
server_key: "baf05c0523ad0ecb411fc54f5ea6939c"
server_key_iv: "42655b369ed7424c9e0ca0d6bd629271"
server_key_version: "encryptionkey@0"
I20260812 00:00:45.028203 6700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:45.044075 6700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:45.046990 6700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:45.047235 6700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:45.047510 6700 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:45.047823 6700 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:45.047860 6700 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:45.047901 6700 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:45.047925 6700 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:45.053726 6700 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:38847
I20260812 00:00:45.053781 6901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:38847 every 8 connection(s)
I20260812 00:00:45.054148 6700 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:00:45 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492845, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:45.063342 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 6700
I20260812 00:00:45.063995 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:00:45.064416 26013 external_mini_cluster.cc:1428] Setting key 90da762f098724e16b35ef65748cb9b6
I20260812 00:00:45.068295 6660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:45.054887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:59879 (local address 127.25.103.126:35039)
0812 00:00:45.054972 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:45.054974 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:45.055114 (+ 140us) server_negotiation.cc:407] Connection header received
0812 00:00:45.055657 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:45.055659 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:45.055674 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:45.055727 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:45.056694 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.057215 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.058403 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.058616 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.058674 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:45.062535 (+ 3861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:45.062536 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:45.062537 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:45.062544 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:45.066363 (+ 3819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:45.067085 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:45.067086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:45.067087 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:45.067162 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:45.067489 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:45.067490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:45.067490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:45.067633 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:45.067698 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:45.068097 (+ 399us) server_negotiation.cc:299] Negotiation successful
0812 00:00:45.068195 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 00:00:45.068467 6909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:45.054796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:59879)
0812 00:00:45.054983 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:45.055030 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:45.055557 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:45.055814 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:45.055818 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:45.056380 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:45.056600 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:45.056605 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.057298 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.057300 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:45.058315 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:45.058318 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.058691 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.058692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:45.058814 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:45.059569 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:45.059578 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:45.062426 (+ 2848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:45.066475 (+ 4049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:45.066578 (+ 103us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:45.066582 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:45.066963 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:45.067233 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:45.067234 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:45.067234 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:45.067394 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:45.067706 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:45.067712 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:45.067898 (+ 186us) client_negotiation.cc:769] Sending connection context
0812 00:00:45.068030 (+ 132us) client_negotiation.cc:240] Negotiation successful
0812 00:00:45.068222 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":90,"threads_started":1}
I20260812 00:00:45.069063 6905 heartbeater.cc:347] Connected to a master server at 127.25.103.126:35039
I20260812 00:00:45.069159 6905 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:45.069378 6905 heartbeater.cc:511] Master 127.25.103.126:35039 requested a full tablet report, sending...
I20260812 00:00:45.069931 6600 ts_manager.cc:194] Registered new tserver with Master: 9f84d1c41c2d4e31bd64a640bfa72a42 (127.25.103.65:38847)
I20260812 00:00:45.070570 6600 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:59879
WARNING: no policy specified for kudu/127.25.103.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
I20260812 00:00:45.097288 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:35039
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:38823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:45.208694 6912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:45.209064 6912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:45.209106 6912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:45.210525 6912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:45.210577 6912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:45.210620 6912 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:00:45.212239 6912 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:38823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:35039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:45.212505 6912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:45.212742 6912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:00:45.218165 6912 server_base.cc:1034] running on GCE node
W20260812 00:00:45.218138 6917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:45.218138 6922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:45.218154 6919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:45.218655 6912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:45.219183 6912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:45.220371 6912 hybrid_clock.cc:648] HybridClock initialized: now 1786492845220358 us; error 30 us; skew 500 ppm
Aug 12 00:00:45 dist-test-slave-vpvm krb5kdc[6534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492845, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:45.224694 6912 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:00:45.225695 6912 webserver.cc:460] Webserver started at http://127.25.103.66:40393/ using document root <none> and password file <none>
I20260812 00:00:45.226030 6912 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:45.226226 6912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:45.226691 6912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:45.227830 6912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "bdb748ca75794ba184a8de54af87135f"
format_stamp: "Formatted at 2026-08-12 00:00:45 on dist-test-slave-vpvm"
server_key: "3fb9e3c7d107b3400e8a8c3feb7f0c5d"
server_key_iv: "093e04946d40feae7ee30f450874f380"
server_key_version: "encryptionkey@0"
I20260812 00:00:45.228142 6912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "bdb748ca75794ba184a8de54af87135f"
format_stamp: "Formatted at 2026-08-12 00:00:45 on dist-test-slave-vpvm"
server_key: "3fb9e3c7d107b3400e8a8c3feb7f0c5d"
server_key_iv: "093e04946d40feae7ee30f450874f380"
server_key_version: "encryptionkey@0"
I20260812 00:00:45.229458 6912 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:00:45.230275 6934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:45.230473 6912 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:45.230564 6912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "bdb748ca75794ba184a8de54af87135f"
format_stamp: "Formatted at 2026-08-12 00:00:45 on dist-test-slave-vpvm"
server_key: "3fb9e3c7d107b3400e8a8c3feb7f0c5d"
server_key_iv: "093e04946d40feae7ee30f450874f380"
server_key_version: "encryptionkey@0"
I20260812 00:00:45.230644 6912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:45.248075 6912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:45.250464 6912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:45.250592 6912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:45.250793 6912 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:45.251117 6912 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:45.251152 6912 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:45.251173 6912 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:45.251186 6912 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:45.257092 6912 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:44849
I20260812 00:00:45.257189 7109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:44849 every 8 connection(s)
I20260812 00:00:45.257486 6912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:00:45 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492845, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:45.267652 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 6912
I20260812 00:00:45.267752 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:00:45.267951 26013 external_mini_cluster.cc:1428] Setting key 1593c9edfb2d996a24a0a615c1552677
I20260812 00:00:45.268018 6660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:45.258352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:43081 (local address 127.25.103.126:35039)
0812 00:00:45.258404 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:45.258406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:45.258509 (+ 103us) server_negotiation.cc:407] Connection header received
0812 00:00:45.259021 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:45.259022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:45.259038 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:45.259097 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:45.260056 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.260581 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.262003 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.262221 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.262289 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:45.265070 (+ 2781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:45.265071 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:45.265072 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:45.265080 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:45.266463 (+ 1383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:45.266895 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:45.266896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:45.266897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:45.266966 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:45.267251 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:45.267252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:45.267252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:45.267383 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:45.267478 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:45.267802 (+ 324us) server_negotiation.cc:299] Negotiation successful
0812 00:00:45.267912 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:00:45.268168 7113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:45.258213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:43081)
0812 00:00:45.258398 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:45.258436 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:45.258917 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:45.259161 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:45.259164 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:45.259758 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:45.259959 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:45.259964 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.260668 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.260669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:45.261821 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:45.261824 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.262348 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.262350 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:45.262535 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:45.263298 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:45.263307 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:45.264869 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:45.266560 (+ 1691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:45.266565 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:45.266567 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:45.266804 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:45.267049 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:45.267050 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:45.267050 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:45.267167 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:45.267502 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:45.267508 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:45.267644 (+ 136us) client_negotiation.cc:769] Sending connection context
0812 00:00:45.267769 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 00:00:45.267935 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":72,"threads_started":1}
I20260812 00:00:45.268616 7110 heartbeater.cc:347] Connected to a master server at 127.25.103.126:35039
I20260812 00:00:45.268723 7110 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:45.268929 7110 heartbeater.cc:511] Master 127.25.103.126:35039 requested a full tablet report, sending...
I20260812 00:00:45.269326 6600 ts_manager.cc:194] Registered new tserver with Master: bdb748ca75794ba184a8de54af87135f (127.25.103.66:44849)
I20260812 00:00:45.269766 6600 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:43081
WARNING: no policy specified for kudu/127.25.103.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
I20260812 00:00:45.296545 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:35039
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:38823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:45.408542 7119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:45.408763 7119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:45.408788 7119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:45.410064 7119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:45.410108 7119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:45.410137 7119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:00:45.411623 7119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:38823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:35039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7119
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:45.411840 7119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:45.412034 7119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:45.417186 7129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:45.417186 7127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:45.418397 7119 server_base.cc:1034] running on GCE node
W20260812 00:00:45.418392 7126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:45.418809 7119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:45.419060 7119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:45.420241 7119 hybrid_clock.cc:648] HybridClock initialized: now 1786492845420224 us; error 36 us; skew 500 ppm
Aug 12 00:00:45 dist-test-slave-vpvm krb5kdc[6534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492845, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:45.422922 7119 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:00:45.423408 7119 webserver.cc:460] Webserver started at http://127.25.103.67:44803/ using document root <none> and password file <none>
I20260812 00:00:45.423660 7119 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:45.423712 7119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:45.423840 7119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:00:45.424954 7119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "e805aa9dd13c48c798b60b921e33c101"
format_stamp: "Formatted at 2026-08-12 00:00:45 on dist-test-slave-vpvm"
server_key: "bdfbe0b6e8086e262dce65392dc33e31"
server_key_iv: "098e7453eb5fd30c3a510d2eaa643d8c"
server_key_version: "encryptionkey@0"
I20260812 00:00:45.425307 7119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "e805aa9dd13c48c798b60b921e33c101"
format_stamp: "Formatted at 2026-08-12 00:00:45 on dist-test-slave-vpvm"
server_key: "bdfbe0b6e8086e262dce65392dc33e31"
server_key_iv: "098e7453eb5fd30c3a510d2eaa643d8c"
server_key_version: "encryptionkey@0"
I20260812 00:00:45.426870 7119 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:00:45.427711 7139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:45.427915 7119 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:45.428020 7119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "e805aa9dd13c48c798b60b921e33c101"
format_stamp: "Formatted at 2026-08-12 00:00:45 on dist-test-slave-vpvm"
server_key: "bdfbe0b6e8086e262dce65392dc33e31"
server_key_iv: "098e7453eb5fd30c3a510d2eaa643d8c"
server_key_version: "encryptionkey@0"
I20260812 00:00:45.428088 7119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:45.438651 7119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:45.440793 7119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:45.440940 7119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:45.441177 7119 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:45.441478 7119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:45.441512 7119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:45.441543 7119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:45.441561 7119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:45.448247 7119 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:43481
I20260812 00:00:45.448292 7319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:43481 every 8 connection(s)
I20260812 00:00:45.448621 7119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:00:45 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492845, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:00:45.454756 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 7119
I20260812 00:00:45.454846 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:00:45.455001 26013 external_mini_cluster.cc:1428] Setting key 97d1ca9cc222440c07e44f1307e9141b
I20260812 00:00:45.458268 6660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:45.449405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:55411 (local address 127.25.103.126:35039)
0812 00:00:45.449491 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:45.449493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:45.449632 (+ 139us) server_negotiation.cc:407] Connection header received
0812 00:00:45.450194 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:45.450196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:45.450209 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:45.450262 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:45.451188 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.451691 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.452671 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.452858 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.452913 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:45.455202 (+ 2289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:45.455204 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:45.455204 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:45.455212 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:45.456740 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:45.457162 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:45.457163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:45.457164 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:45.457226 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:45.457426 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:45.457427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:45.457427 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:45.457635 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:45.457703 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:45.458042 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 00:00:45.458195 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 00:00:45.458320 7328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:45.449299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.67:55411)
0812 00:00:45.449493 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:45.449540 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:45.450098 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:45.450330 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:45.450335 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:45.450890 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:45.451099 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:45.451103 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.451776 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.451777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:45.452592 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:45.452594 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.452928 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.452929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:45.453055 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:45.453566 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:45.453575 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:45.455104 (+ 1529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:00:45.456853 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:45.456859 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:45.456861 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:45.457090 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:45.457280 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:00:45.457280 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:00:45.457281 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:00:45.457375 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:00:45.457708 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:00:45.457713 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:00:45.457848 (+ 135us) client_negotiation.cc:769] Sending connection context
0812 00:00:45.457942 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 00:00:45.458144 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":80,"threads_started":1}
I20260812 00:00:45.458978 7320 heartbeater.cc:347] Connected to a master server at 127.25.103.126:35039
I20260812 00:00:45.459193 7320 heartbeater.cc:464] Registering TS with master...
I20260812 00:00:45.459519 7320 heartbeater.cc:511] Master 127.25.103.126:35039 requested a full tablet report, sending...
I20260812 00:00:45.460003 6600 ts_manager.cc:194] Registered new tserver with Master: e805aa9dd13c48c798b60b921e33c101 (127.25.103.67:43481)
I20260812 00:00:45.460362 6600 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:55411
I20260812 00:00:45.467379 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.65.keytab.
Entry for principal oryx/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.65.keytab.
WARNING: no policy specified for oryx/127.25.103.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.66.keytab.
Entry for principal oryx/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.66.keytab.
WARNING: no policy specified for oryx/127.25.103.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.67.keytab.
Entry for principal oryx/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.67.keytab.
I20260812 00:00:45.548368 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 6700
I20260812 00:00:45.561337 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 6912
I20260812 00:00:45.571834 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 7119
I20260812 00:00:45.606688 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 6553
I20260812 00:00:45.626545 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:35039
--webserver_interface=127.25.103.126
--webserver_port=37917
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:38823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:35039
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:00:45.713343 7340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:45.713577 7340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:45.713603 7340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:45.714911 7340 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:00:45.714968 7340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:45.714989 7340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:45.715003 7340 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:00:45.715018 7340 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:00:45.716655 7340 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:38823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:35039
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:35039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=37917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:45.717183 7340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:45.717724 7340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:45.724800 7349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:45.724929 7348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:45.724788 7351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:45.725095 7340 server_base.cc:1034] running on GCE node
I20260812 00:00:45.725425 7340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:45.725862 7340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:45.727144 7340 hybrid_clock.cc:648] HybridClock initialized: now 1786492845727128 us; error 32 us; skew 500 ppm
Aug 12 00:00:45 dist-test-slave-vpvm krb5kdc[6534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492845, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:45.729728 7340 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:00:45.730226 7340 webserver.cc:460] Webserver started at http://127.25.103.126:37917/ using document root <none> and password file <none>
I20260812 00:00:45.730413 7340 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:45.730468 7340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:45.731827 7340 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:45.732574 7365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:45.732761 7340 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:45.732849 7340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "a83fc220418f4139896b2869fc5e3410"
format_stamp: "Formatted at 2026-08-12 00:00:44 on dist-test-slave-vpvm"
server_key: "deda8d3cf03c3b69df22b86fe0eaf8da"
server_key_iv: "691427c3993766d0b7e421cf5c304477"
server_key_version: "encryptionkey@0"
I20260812 00:00:45.733201 7340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:45.747402 7340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:45.749698 7340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:45.749818 7340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:45.754518 7340 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:35039
I20260812 00:00:45.754590 7446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:35039 every 8 connection(s)
I20260812 00:00:45.754952 7340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:00:45.756448 7447 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:00:45.757546 7447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410: Bootstrap starting.
I20260812 00:00:45.763320 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 7340
I20260812 00:00:45.763590 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:38847
--local_ip_for_outbound_sockets=127.25.103.65
--tserver_master_addrs=127.25.103.126:35039
--webserver_port=37989
--webserver_interface=127.25.103.65
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:38823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.25.103.65
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:00:45.770466 7447 log.cc:824] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410: Log is configured to *not* fsync() on all Append() calls
I20260812 00:00:45.772259 7447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:00:45.772554 7447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410: Bootstrap complete.
I20260812 00:00:45.774760 7447 raft_consensus.cc:348] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a83fc220418f4139896b2869fc5e3410" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35039 } }
I20260812 00:00:45.774994 7447 raft_consensus.cc:729] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83fc220418f4139896b2869fc5e3410, State: Initialized, Role: FOLLOWER
I20260812 00:00:45.775157 7447 consensus_queue.cc:260] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a83fc220418f4139896b2869fc5e3410" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35039 } }
I20260812 00:00:45.775235 7447 raft_consensus.cc:388] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:00:45.775285 7447 raft_consensus.cc:482] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:00:45.775331 7447 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:00:45.776350 7447 raft_consensus.cc:504] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a83fc220418f4139896b2869fc5e3410" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35039 } }
I20260812 00:00:45.776449 7447 leader_election.cc:302] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a83fc220418f4139896b2869fc5e3410; no voters:
I20260812 00:00:45.776638 7447 leader_election.cc:288] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:00:45.776721 7455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:00:45.776906 7455 raft_consensus.cc:686] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [term 2 LEADER]: Becoming Leader. State: Replica: a83fc220418f4139896b2869fc5e3410, State: Running, Role: LEADER
I20260812 00:00:45.777012 7455 consensus_queue.cc:237] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a83fc220418f4139896b2869fc5e3410" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35039 } }
I20260812 00:00:45.777065 7447 sys_catalog.cc:564] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:00:45.777309 7459 sys_catalog.cc:455] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a83fc220418f4139896b2869fc5e3410. Latest consensus state: current_term: 2 leader_uuid: "a83fc220418f4139896b2869fc5e3410" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a83fc220418f4139896b2869fc5e3410" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35039 } } }
I20260812 00:00:45.777350 7455 sys_catalog.cc:455] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a83fc220418f4139896b2869fc5e3410" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a83fc220418f4139896b2869fc5e3410" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 35039 } } }
I20260812 00:00:45.777475 7459 sys_catalog.cc:458] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:45.777505 7455 sys_catalog.cc:458] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410 [sys.catalog]: This master's current role is: LEADER
I20260812 00:00:45.778210 7469 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:00:45.778728 7469 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:00:45.778851 7469 catalog_manager.cc:1259] Loaded cluster ID: ea4771d632e5431e8a55036410e89589
I20260812 00:00:45.778882 7469 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:00:45.780061 7469 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:00:45.780257 7469 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a83fc220418f4139896b2869fc5e3410: Loaded TSK: 0
I20260812 00:00:45.780592 7469 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:00:45.850979 7452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:45.851222 7452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:45.851248 7452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:45.852541 7452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:45.852596 7452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:45.852625 7452 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:00:45.854270 7452 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:38823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.65.keytab
--principal=oryx/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:38847
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=37989
--tserver_master_addrs=127.25.103.126:35039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7452
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:45.854526 7452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:45.854772 7452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:45.860317 7493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:45.860294 7496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:45.860294 7494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:45.861096 7452 server_base.cc:1034] running on GCE node
I20260812 00:00:45.861312 7452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:45.861557 7452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:45.862725 7452 hybrid_clock.cc:648] HybridClock initialized: now 1786492845862706 us; error 33 us; skew 500 ppm
Aug 12 00:00:45 dist-test-slave-vpvm krb5kdc[6534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492845, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:45.865299 7452 init.cc:377] Logged in from keytab as oryx/127.25.103.65@KRBTEST.COM (short username oryx)
I20260812 00:00:45.865759 7452 webserver.cc:460] Webserver started at http://127.25.103.65:37989/ using document root <none> and password file <none>
I20260812 00:00:45.866025 7452 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:45.866096 7452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:45.867519 7452 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:45.868203 7510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:45.868458 7452 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:45.868570 7452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "9f84d1c41c2d4e31bd64a640bfa72a42"
format_stamp: "Formatted at 2026-08-12 00:00:45 on dist-test-slave-vpvm"
server_key: "baf05c0523ad0ecb411fc54f5ea6939c"
server_key_iv: "42655b369ed7424c9e0ca0d6bd629271"
server_key_version: "encryptionkey@0"
I20260812 00:00:45.869038 7452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:45.888679 7452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:45.891697 7452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:45.891899 7452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:45.892222 7452 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:45.892644 7452 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:45.892714 7452 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:45.892748 7452 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:45.892767 7452 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:45.900813 7452 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:38847
I20260812 00:00:45.900851 7687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:38847 every 8 connection(s)
I20260812 00:00:45.901291 7452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:00:45 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:45 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:45.909897 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 7452
I20260812 00:00:45.910233 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:44849
--local_ip_for_outbound_sockets=127.25.103.66
--tserver_master_addrs=127.25.103.126:35039
--webserver_port=40393
--webserver_interface=127.25.103.66
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:38823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.25.103.66
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:00:45.910872 7693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:45.902115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:59383)
0812 00:00:45.902309 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:45.902359 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:45.903021 (+ 662us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:45.903561 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:45.903565 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:45.904342 (+ 777us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:45.904640 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:45.904647 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.905863 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.905864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:45.907088 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:45.907092 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.907745 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.907747 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:45.907879 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:45.908388 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:45.908396 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:45.910663 (+ 2267us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":93,"threads_started":1}
W20260812 00:00:45.911127 7688 heartbeater.cc:644] Failed to heartbeat to 127.25.103.126:35039 (0 consecutive failures): Not authorized: Failed to ping master at 127.25.103.126:35039: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
W20260812 00:00:45.911289 7694 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:45.902207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:59383 (local address 127.25.103.126:35039)
0812 00:00:45.902408 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:45.902416 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:45.902449 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:00:45.903319 (+ 870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:45.903325 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:45.903370 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:45.903486 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:45.904777 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.905754 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.907188 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.907641 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.907746 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:45.910811 (+ 3065us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.65:59383: BlockingRecv error: recv got EOF from 127.25.103.65:59383 (error 108)
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":79,"threads_started":1}
Aug 12 00:00:45 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:45 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:45.916702 7693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:45.911349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:59697)
0812 00:00:45.911543 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:45.911554 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:45.911600 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:45.911802 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:45.911802 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:45.911951 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:45.912012 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:45.912015 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.912908 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.912909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:45.913559 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:45.913562 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.913887 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.913888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:45.913983 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:45.914468 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:45.914473 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:45.916611 (+ 2138us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":86,"threads_started":1}
W20260812 00:00:45.916806 7694 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:45.911544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:59697 (local address 127.25.103.126:35039)
0812 00:00:45.911698 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:45.911700 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:45.911706 (+ 6us) server_negotiation.cc:407] Connection header received
0812 00:00:45.911725 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:45.911726 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:45.911735 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:45.911782 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:45.912119 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.912810 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.913641 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.913826 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.913883 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:45.916738 (+ 2855us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.65:59697: BlockingRecv error: recv got EOF from 127.25.103.65:59697 (error 108)
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":97,"threads_started":1}
Aug 12 00:00:45 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:45 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:45.922652 7693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:45.917259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:43693)
0812 00:00:45.917368 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:45.917379 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:45.917429 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:45.917563 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:45.917565 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:45.917705 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:45.917750 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:45.917752 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.918669 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.918671 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:45.919435 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:45.919438 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.919892 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.919893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:45.919952 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:45.920399 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:45.920404 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:45.922565 (+ 2161us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":90}
W20260812 00:00:45.923207 7694 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:45.917322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:43693 (local address 127.25.103.126:35039)
0812 00:00:45.917375 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:45.917377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:45.917413 (+ 36us) server_negotiation.cc:407] Connection header received
0812 00:00:45.917485 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:45.917486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:45.917496 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:45.917562 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:45.917824 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.918581 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.919531 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:45.919810 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:45.919884 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:45.923148 (+ 3264us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.65:43693: BlockingRecv error: recv got EOF from 127.25.103.65:43693 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260812 00:00:45.923593 7688 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:00:45.998754 7697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:45.998986 7697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:45.999010 7697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:46.000197 7697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:46.000237 7697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:46.000263 7697 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:00:46.001830 7697 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:38823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.66.keytab
--principal=oryx/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:44849
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=40393
--tserver_master_addrs=127.25.103.126:35039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:46.002079 7697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:46.002276 7697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:46.007305 7703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:46.007371 7697 server_base.cc:1034] running on GCE node
W20260812 00:00:46.007301 7706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:46.007297 7704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:46.007746 7697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:46.007987 7697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:46.009157 7697 hybrid_clock.cc:648] HybridClock initialized: now 1786492846009137 us; error 37 us; skew 500 ppm
Aug 12 00:00:46 dist-test-slave-vpvm krb5kdc[6534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492846, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:46.011914 7697 init.cc:377] Logged in from keytab as oryx/127.25.103.66@KRBTEST.COM (short username oryx)
I20260812 00:00:46.012394 7697 webserver.cc:460] Webserver started at http://127.25.103.66:40393/ using document root <none> and password file <none>
I20260812 00:00:46.012588 7697 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:46.012655 7697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:46.014055 7697 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:46.014859 7721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:46.015061 7697 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:46.015143 7697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "bdb748ca75794ba184a8de54af87135f"
format_stamp: "Formatted at 2026-08-12 00:00:45 on dist-test-slave-vpvm"
server_key: "3fb9e3c7d107b3400e8a8c3feb7f0c5d"
server_key_iv: "093e04946d40feae7ee30f450874f380"
server_key_version: "encryptionkey@0"
I20260812 00:00:46.015618 7697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:46.035436 7697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:46.037690 7697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:46.037809 7697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:46.038057 7697 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:46.038367 7697 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:46.038401 7697 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:46.038422 7697 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:46.038434 7697 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:46.043998 7697 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:44849
I20260812 00:00:46.044061 7896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:44849 every 8 connection(s)
I20260812 00:00:46.044381 7697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:00:46.047912 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 7697
I20260812 00:00:46.048249 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:43481
--local_ip_for_outbound_sockets=127.25.103.67
--tserver_master_addrs=127.25.103.126:35039
--webserver_port=44803
--webserver_interface=127.25.103.67
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:38823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.25.103.67
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:00:46 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:46 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:46.053036 7899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:46.045122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:39075)
0812 00:00:46.045308 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:46.045349 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:46.045835 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:46.046208 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:46.046211 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:46.046807 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:46.047006 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:46.047011 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.047933 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.047934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:46.049134 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:46.049138 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.049548 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.049549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:46.049703 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:46.050400 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:46.050409 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:46.052871 (+ 2462us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":96,"threads_started":1}
W20260812 00:00:46.053104 7694 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:46.045139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:39075 (local address 127.25.103.126:35039)
0812 00:00:46.045241 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:46.045243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:46.045466 (+ 223us) server_negotiation.cc:407] Connection header received
0812 00:00:46.046020 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:46.046021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:46.046036 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:46.046100 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:46.047116 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.047805 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.049253 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.049456 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.049521 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:46.053034 (+ 3513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.66:39075: BlockingRecv error: recv got EOF from 127.25.103.66:39075 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260812 00:00:46.053278 7897 heartbeater.cc:644] Failed to heartbeat to 127.25.103.126:35039 (0 consecutive failures): Not authorized: Failed to ping master at 127.25.103.126:35039: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Aug 12 00:00:46 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:46 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:46.058204 7899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:46.053497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:58757)
0812 00:00:46.053553 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:46.053566 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:46.053621 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:46.053755 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:46.053756 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:46.053914 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:46.054003 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:46.054006 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.054635 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.054636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:46.055410 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:46.055414 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.055794 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.055795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:46.055864 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:46.056290 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:46.056295 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:46.058149 (+ 1854us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 00:00:46.058339 7694 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:46.053564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:58757 (local address 127.25.103.126:35039)
0812 00:00:46.053611 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:46.053613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:46.053622 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:46.053693 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:46.053693 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:46.053702 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:46.053744 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:46.054081 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.054559 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.055523 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.055720 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.055780 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:46.058273 (+ 2493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.66:58757: BlockingRecv error: recv got EOF from 127.25.103.66:58757 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 12 00:00:46 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:46 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:46.063551 7901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:46.058446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:58491)
0812 00:00:46.058621 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:46.058633 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:46.058693 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:46.058859 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:46.058860 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:46.059044 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:46.059117 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:46.059120 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.059879 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.059881 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:46.060731 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:46.060734 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.061130 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.061132 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:46.061195 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:46.061650 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:46.061655 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:46.063479 (+ 1824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":94,"threads_started":1}
W20260812 00:00:46.063643 7694 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:46.058641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:58491 (local address 127.25.103.126:35039)
0812 00:00:46.058690 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:46.058691 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:46.058699 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:00:46.058777 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:46.058778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:46.058786 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:46.058834 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:46.059238 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.059793 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.060842 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.061040 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.061095 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:46.063577 (+ 2482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.66:58491: BlockingRecv error: recv got EOF from 127.25.103.66:58491 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260812 00:00:46.063690 7897 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:00:46.139824 7900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:00:46.140053 7900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:00:46.140082 7900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:00:46.141270 7900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:00:46.141309 7900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:00:46.141335 7900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:00:46.142863 7900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:38823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/krb5kdc/oryx_127.25.103.67.keytab
--principal=oryx/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:43481
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=44803
--tserver_master_addrs=127.25.103.126:35039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:00:46.143079 7900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:00:46.143304 7900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:00:46.148393 7908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:46.148419 7910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:00:46.148397 7912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:00:46.148689 7900 server_base.cc:1034] running on GCE node
I20260812 00:00:46.148952 7900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:00:46.149178 7900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:00:46.150355 7900 hybrid_clock.cc:648] HybridClock initialized: now 1786492846150335 us; error 31 us; skew 500 ppm
Aug 12 00:00:46 dist-test-slave-vpvm krb5kdc[6534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492846, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:00:46.153121 7900 init.cc:377] Logged in from keytab as oryx/127.25.103.67@KRBTEST.COM (short username oryx)
I20260812 00:00:46.153563 7900 webserver.cc:460] Webserver started at http://127.25.103.67:44803/ using document root <none> and password file <none>
I20260812 00:00:46.153784 7900 fs_manager.cc:359] Metadata directory not provided
I20260812 00:00:46.153849 7900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:00:46.155349 7900 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:46.156080 7922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:46.156355 7900 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:00:46.156463 7900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "e805aa9dd13c48c798b60b921e33c101"
format_stamp: "Formatted at 2026-08-12 00:00:45 on dist-test-slave-vpvm"
server_key: "bdfbe0b6e8086e262dce65392dc33e31"
server_key_iv: "098e7453eb5fd30c3a510d2eaa643d8c"
server_key_version: "encryptionkey@0"
I20260812 00:00:46.156996 7900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:00:46.171077 7900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:00:46.173308 7900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:00:46.173453 7900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:00:46.173695 7900 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:00:46.174067 7900 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:00:46.174106 7900 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:46.174137 7900 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:00:46.174162 7900 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:00:46.180224 7900 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:43481
I20260812 00:00:46.180347 8101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:43481 every 8 connection(s)
I20260812 00:00:46.180653 7900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:00:46.185617 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 7900
Aug 12 00:00:46 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:46 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:00:46.188710 7694 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:46.181445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:57049 (local address 127.25.103.126:35039)
0812 00:00:46.181518 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:46.181520 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:46.181742 (+ 222us) server_negotiation.cc:407] Connection header received
0812 00:00:46.182255 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:46.182256 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:46.182266 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:46.182335 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:46.183359 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.183861 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.184944 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.185140 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.185198 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:46.188649 (+ 3451us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.67:57049: BlockingRecv error: recv got EOF from 127.25.103.67:57049 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 00:00:46.188726 8109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:46.181421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.67:57049)
0812 00:00:46.181584 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:46.181627 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:46.182160 (+ 533us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:46.182389 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:46.182393 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:46.182972 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:46.183192 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:46.183197 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.183980 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.183981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:46.184796 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:46.184798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.185240 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.185241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:46.185377 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:46.186049 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:46.186061 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:46.188512 (+ 2451us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":78,"threads_started":1}
W20260812 00:00:46.188959 8103 heartbeater.cc:644] Failed to heartbeat to 127.25.103.126:35039 (0 consecutive failures): Not authorized: Failed to ping master at 127.25.103.126:35039: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Aug 12 00:00:46 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:46 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:46.194084 8109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:46.189164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.67:32919)
0812 00:00:46.189213 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:46.189223 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:46.189258 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:46.189422 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:46.189423 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:46.189548 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:46.189598 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:46.189599 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.190682 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.190683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:46.191384 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:46.191388 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.191702 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.191703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:46.191765 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:46.192135 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:46.192140 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:46.194007 (+ 1867us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 00:00:46.194164 7696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:46.186151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59960 (local address 127.25.103.126:35039)
0812 00:00:46.186223 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:46.186225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:46.186234 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:46.186258 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:46.186259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:46.186271 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:46.186351 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:46.186954 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.187477 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.188306 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.188585 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.188659 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:46.190450 (+ 1791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:00:46.190455 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:00:46.190455 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:00:46.190470 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:00:46.192510 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:46.192858 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:46.192862 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:46.192862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:46.193002 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:00:46.193248 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:00:46.193250 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:00:46.193250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:00:46.193589 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:00:46.193744 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 00:00:46.193917 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 00:00:46.194085 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260812 00:00:46.194334 7694 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:46.189214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:32919 (local address 127.25.103.126:35039)
0812 00:00:46.189259 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:46.189261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:46.189291 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:00:46.189311 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:46.189312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:46.189322 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:46.189362 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:46.189684 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.190492 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.191470 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.191646 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.191699 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:46.194290 (+ 2591us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.67:32919: BlockingRecv error: recv got EOF from 127.25.103.67:32919 (error 108)
Metrics: {"mutex_wait_us":195,"server-negotiator.queue_time_us":23}
Aug 12 00:00:46 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:46 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:46.198923 8109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:46.194488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.67:58645)
0812 00:00:46.194586 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:46.194596 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:46.194641 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:46.194759 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:46.194759 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:46.194876 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:46.194902 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:46.194903 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.195625 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.195626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:46.196226 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:46.196229 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.196590 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.196591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:46.196637 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:46.197058 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:46.197064 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:46.198871 (+ 1807us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":79}
W20260812 00:00:46.199066 7694 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:46.194549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:58645 (local address 127.25.103.126:35039)
0812 00:00:46.194632 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:46.194634 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:46.194641 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:00:46.194693 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:46.194694 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:46.194703 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:46.194749 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:46.194966 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.195511 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.196326 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.196504 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.196565 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:46.199000 (+ 2435us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.67:58645: BlockingRecv error: recv got EOF from 127.25.103.67:58645 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260812 00:00:46.199077 8103 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 00:00:46 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:46 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:46.930186 8112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:46.924140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:36019)
0812 00:00:46.924397 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:46.924413 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:46.924512 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:46.924770 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:46.924772 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:46.924998 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:46.925103 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:46.925105 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.925928 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.925929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:46.926592 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:46.926595 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.927123 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.927125 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:46.927256 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:46.927807 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:46.927811 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:46.930110 (+ 2299us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":141,"threads_started":1}
W20260812 00:00:46.930341 8114 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:46.924272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:36019 (local address 127.25.103.126:35039)
0812 00:00:46.924429 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:46.924431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:46.924523 (+ 92us) server_negotiation.cc:407] Connection header received
0812 00:00:46.924572 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:46.924573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:46.924589 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:46.924679 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:46.925206 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.925820 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.926741 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:46.926959 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:46.927023 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:46.930261 (+ 3238us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.65:36019: BlockingRecv error: recv got EOF from 127.25.103.65:36019 (error 108)
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":80,"threads_started":1}
Aug 12 00:00:47 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:47 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:47.070564 8115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:47.064314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:40555)
0812 00:00:47.064515 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:47.064528 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:47.064640 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:47.064914 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:47.064917 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:47.065117 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:47.065304 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:47.065309 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:47.066265 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:47.066267 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:47.066905 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:47.066907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:47.067476 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:47.067477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:47.067558 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:47.068080 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:47.068084 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:47.070446 (+ 2362us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":123,"threads_started":1}
W20260812 00:00:47.070643 8114 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:47.064392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:40555 (local address 127.25.103.126:35039)
0812 00:00:47.064517 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:47.064520 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:47.064650 (+ 130us) server_negotiation.cc:407] Connection header received
0812 00:00:47.064697 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:47.064698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:47.064716 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:47.064820 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:47.065471 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:47.066139 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:47.067092 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:47.067333 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:47.067430 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:47.070577 (+ 3147us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.66:40555: BlockingRecv error: recv got EOF from 127.25.103.66:40555 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 12 00:00:47 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:47 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:47.205670 8116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:47.199527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.67:49407)
0812 00:00:47.199683 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:47.199695 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:47.199757 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:47.199976 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:47.199977 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:47.200285 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:47.200355 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:47.200358 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:47.201259 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:47.201260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:47.201880 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:47.201883 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:47.202367 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:47.202369 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:47.202448 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:47.203096 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:47.203101 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:47.205573 (+ 2472us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":90,"threads_started":1}
W20260812 00:00:47.205806 8114 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:47.199656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:49407 (local address 127.25.103.126:35039)
0812 00:00:47.199785 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:47.199787 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:47.199800 (+ 13us) server_negotiation.cc:407] Connection header received
0812 00:00:47.199835 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:47.199836 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:47.199856 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:47.199951 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:47.200509 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:47.201143 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:47.202010 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:47.202234 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:47.202302 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:47.205738 (+ 3436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.67:49407: BlockingRecv error: recv got EOF from 127.25.103.67:49407 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 12 00:00:47 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:47 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:47.935424 8117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:47.930698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:41957)
0812 00:00:47.930881 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:47.930891 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:47.930961 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:47.931123 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:47.931125 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:47.931300 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:47.931363 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:47.931365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:47.932124 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:47.932129 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:47.932680 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:47.932681 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:47.933086 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:47.933087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:47.933137 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:47.933629 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:47.933635 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:47.935353 (+ 1718us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":73,"threads_started":1}
W20260812 00:00:47.935647 8118 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:47.930750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:41957 (local address 127.25.103.126:35039)
0812 00:00:47.930872 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:47.930874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:47.930939 (+ 65us) server_negotiation.cc:407] Connection header received
0812 00:00:47.931012 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:47.931012 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:47.931024 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:47.931082 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:47.931497 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:47.932030 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:47.932774 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:47.932988 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:47.933056 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:47.935546 (+ 2490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.65:41957: BlockingRecv error: recv got EOF from 127.25.103.65:41957 (error 108)
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":73,"threads_started":1}
Aug 12 00:00:48 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:48 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:48.076010 8119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:48.071191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:38861)
0812 00:00:48.071352 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:48.071366 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:48.071464 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:48.071600 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:48.071601 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:48.071783 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:48.071833 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:48.071835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:48.072486 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:48.072487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:48.073010 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:48.073011 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:48.073335 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:48.073336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:48.073420 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:48.073866 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:48.073872 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:48.075944 (+ 2072us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":78,"threads_started":1}
W20260812 00:00:48.076161 8118 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:48.071313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:38861 (local address 127.25.103.126:35039)
0812 00:00:48.071370 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:48.071372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:48.071449 (+ 77us) server_negotiation.cc:407] Connection header received
0812 00:00:48.071528 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:48.071529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:48.071542 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:48.071587 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:48.071910 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:48.072412 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:48.073081 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:48.073274 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:48.073328 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:48.076089 (+ 2761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.66:38861: BlockingRecv error: recv got EOF from 127.25.103.66:38861 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 12 00:00:48 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:48 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:48.211333 8121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:48.206425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.67:51261)
0812 00:00:48.206758 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:48.206862 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:48.206939 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:48.207108 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:48.207109 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:48.207272 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:48.207328 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:48.207330 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:48.207999 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:48.208000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:48.208537 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:48.208539 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:48.208901 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:48.208901 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:48.208937 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:48.209363 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:48.209367 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:48.211253 (+ 1886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":82,"threads_started":1}
W20260812 00:00:48.211408 8118 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:48.206762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:51261 (local address 127.25.103.126:35039)
0812 00:00:48.206935 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:48.206936 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:48.206948 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:00:48.206996 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:48.206997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:48.207011 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:48.207053 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:48.207392 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:48.207902 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:48.208639 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:48.208840 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:48.208898 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:48.211353 (+ 2455us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.67:51261: BlockingRecv error: recv got EOF from 127.25.103.67:51261 (error 108)
Metrics: {"server-negotiator.queue_time_us":145}
Aug 12 00:00:48 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:48 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:48.942979 8122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:48.935892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:54965)
0812 00:00:48.936054 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:48.936066 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:48.936129 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:48.936357 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:48.936359 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:48.936564 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:48.936627 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:48.936629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:48.937431 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:48.937433 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:48.938465 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:48.938469 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:48.939020 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:48.939022 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:48.939074 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:48.940267 (+ 1193us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:48.940272 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:48.942898 (+ 2626us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":71,"threads_started":1}
W20260812 00:00:48.943043 8123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:48.935999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:54965 (local address 127.25.103.126:35039)
0812 00:00:48.936110 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:48.936112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:48.936121 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:48.936235 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:48.936237 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:48.936250 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:48.936315 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:48.936704 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:48.937272 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:48.938577 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:48.938850 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:48.939015 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:48.942980 (+ 3965us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.65:54965: BlockingRecv error: recv got EOF from 127.25.103.65:54965 (error 108)
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":53,"threads_started":1}
Aug 12 00:00:49 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:49 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:49.085331 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:49.076637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:36767)
0812 00:00:49.076763 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:49.076774 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:49.076840 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:49.077003 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:49.077004 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:49.077183 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:49.077236 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:49.077237 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:49.078362 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:49.078364 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:49.079364 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:49.079368 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:49.080211 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:49.080212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:49.080474 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:49.081720 (+ 1246us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:49.081726 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:49.085260 (+ 3534us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":64,"threads_started":1}
W20260812 00:00:49.085835 8123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:49.076749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:36767 (local address 127.25.103.126:35039)
0812 00:00:49.076819 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:49.076820 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:49.076832 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:00:49.076902 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:49.076903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:49.076917 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:49.076968 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:49.077383 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:49.078238 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:49.079463 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:49.080016 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:49.080192 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:49.085673 (+ 5481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.66:36767: BlockingRecv error: recv got EOF from 127.25.103.66:36767 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 00:00:49 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:49 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:49.216655 8125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:49.211937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.67:37945)
0812 00:00:49.212090 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:49.212100 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:49.212150 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:49.212328 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:49.212328 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:49.212497 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:49.212555 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:49.212557 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:49.213279 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:49.213280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:49.213830 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:49.213832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:49.214277 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:49.214278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:49.214338 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:49.214768 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:49.214773 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:49.216552 (+ 1779us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":93,"threads_started":1}
W20260812 00:00:49.216702 8123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:49.212046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:37945 (local address 127.25.103.126:35039)
0812 00:00:49.212137 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:49.212138 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:49.212150 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:00:49.212216 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:49.212217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:49.212233 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:49.212297 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:49.212662 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:49.213171 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:49.213934 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:49.214165 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:49.214228 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:49.216650 (+ 2422us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.67:37945: BlockingRecv error: recv got EOF from 127.25.103.67:37945 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 12 00:00:49 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:49 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:49.949827 8127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:49.943848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:56503)
0812 00:00:49.944025 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:49.944036 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:49.944090 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:49.944383 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:49.944385 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:49.944632 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:49.944784 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:49.944788 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:49.945640 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:49.945641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:49.946260 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:49.946262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:49.946670 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:49.946672 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:49.946757 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:49.947523 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:49.947529 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:49.949760 (+ 2231us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":103,"threads_started":1}
W20260812 00:00:49.950018 8128 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:49.943986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:56503 (local address 127.25.103.126:35039)
0812 00:00:49.944140 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:49.944142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:49.944152 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:00:49.944181 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:49.944181 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:49.944194 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:49.944282 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:49.944924 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:49.945480 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:49.946341 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:49.946571 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:49.946659 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:49.949895 (+ 3236us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.65:56503: BlockingRecv error: recv got EOF from 127.25.103.65:56503 (error 108)
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":75,"threads_started":1}
Aug 12 00:00:50 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:50 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:50.091815 8129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:50.086067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:51615)
0812 00:00:50.086237 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:50.086248 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:50.086308 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:50.086542 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:50.086545 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:50.086893 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:50.086950 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:50.086953 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:50.087702 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:50.087703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:50.088244 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:50.088246 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:50.088749 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:50.088751 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:50.088842 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:50.089426 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:50.089432 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:50.091726 (+ 2294us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":95,"threads_started":1}
W20260812 00:00:50.091953 8128 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:50.086174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:51615 (local address 127.25.103.126:35039)
0812 00:00:50.086261 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:50.086262 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:50.086293 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:00:50.086369 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:50.086370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:50.086388 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:50.086444 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:50.087060 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:50.087588 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:50.088334 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:50.088560 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:50.088639 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:50.091874 (+ 3235us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.66:51615: BlockingRecv error: recv got EOF from 127.25.103.66:51615 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 12 00:00:50 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:50 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:50.223480 8130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:50.217351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.67:39449)
0812 00:00:50.217618 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:50.217636 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:50.217763 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:50.218029 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:50.218031 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:50.218234 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:50.218291 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:50.218293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:50.219005 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:50.219007 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:50.219593 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:50.219595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:50.220059 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:50.220060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:50.220156 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:50.220868 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:50.220874 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:50.223391 (+ 2517us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":141,"threads_started":1}
W20260812 00:00:50.223759 8128 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:50.217592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:39449 (local address 127.25.103.126:35039)
0812 00:00:50.217667 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:50.217669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:50.217747 (+ 78us) server_negotiation.cc:407] Connection header received
0812 00:00:50.217842 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:50.217843 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:50.217861 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:50.217975 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:50.218377 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:50.218886 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:50.219690 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:50.219896 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:50.219966 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:50.223697 (+ 3731us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.67:39449: BlockingRecv error: recv got EOF from 127.25.103.67:39449 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 12 00:00:50 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:50 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:50.962626 8131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:50.950443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:44541)
0812 00:00:50.950605 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:50.950616 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:50.950673 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:50.951201 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:50.951202 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:50.951372 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:50.951431 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:50.951433 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:50.952328 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:50.952330 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:50.952924 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:50.952925 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:50.953376 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:50.953377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:50.953418 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:50.959607 (+ 6189us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:50.959615 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:50.962534 (+ 2919us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":70,"threads_started":1}
W20260812 00:00:50.962894 8132 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:50.950661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:44541 (local address 127.25.103.126:35039)
0812 00:00:50.951022 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:50.951034 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:50.951048 (+ 14us) server_negotiation.cc:407] Connection header received
0812 00:00:50.951080 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:50.951081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:50.951095 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:50.951172 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:50.951572 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:50.952201 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:50.953052 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:50.953301 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:50.953372 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:50.962812 (+ 9440us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.65:44541: BlockingRecv error: recv got EOF from 127.25.103.65:44541 (error 108)
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":191,"threads_started":1}
Aug 12 00:00:51 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:51 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:51.099357 8133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:51.092705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:58765)
0812 00:00:51.092904 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:51.092921 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:51.093020 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:51.093296 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:51.093297 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:51.093528 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:51.093605 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:51.093608 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:51.094621 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:51.094622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:51.095676 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:51.095681 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:51.096327 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:51.096344 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:51.096430 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:51.096959 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:51.096965 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:51.099272 (+ 2307us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":107,"threads_started":1}
W20260812 00:00:51.099462 8132 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:51.092908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:58765 (local address 127.25.103.126:35039)
0812 00:00:51.093017 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:51.093019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:51.093036 (+ 17us) server_negotiation.cc:407] Connection header received
0812 00:00:51.093158 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:51.093159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:51.093180 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:51.093256 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:51.093739 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:51.094511 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:51.095900 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:51.096239 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:51.096315 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:51.099395 (+ 3080us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.66:58765: BlockingRecv error: recv got EOF from 127.25.103.66:58765 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 12 00:00:51 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:51 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:51.230480 8136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:51.224134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.67:60737)
0812 00:00:51.224306 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:51.224317 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:51.224377 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:51.224566 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:51.224567 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:51.224767 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:51.224926 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:51.224932 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:51.225733 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:51.225734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:51.226632 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:51.226638 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:51.227065 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:51.227066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:51.227138 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:51.227678 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:51.227684 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:51.230404 (+ 2720us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":98,"threads_started":1}
W20260812 00:00:51.230661 8132 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:51.224251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:60737 (local address 127.25.103.126:35039)
0812 00:00:51.224354 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:51.224357 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:51.224371 (+ 14us) server_negotiation.cc:407] Connection header received
0812 00:00:51.224447 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:51.224448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:51.224465 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:51.224539 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:51.225067 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:51.225611 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:51.226752 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:51.226968 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:51.227036 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:51.230575 (+ 3539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.67:60737: BlockingRecv error: recv got EOF from 127.25.103.67:60737 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 12 00:00:51 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:51 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:51.970029 8137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:51.963324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:55301)
0812 00:00:51.963687 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:51.963704 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:51.963805 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:51.964142 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:51.964144 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:51.964347 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:51.964413 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:51.964415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:51.965349 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:51.965351 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:51.966070 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:51.966072 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:51.966759 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:51.966761 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:51.966837 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:51.967571 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:51.967577 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:51.969909 (+ 2332us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":199,"threads_started":1}
W20260812 00:00:51.970230 8138 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:51.963523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:55301 (local address 127.25.103.126:35039)
0812 00:00:51.963763 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:51.963765 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:51.963784 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:00:51.963945 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:51.963946 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:51.963962 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:51.964050 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:51.964610 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:51.965155 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:51.966214 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:51.966644 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:51.966726 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:51.970150 (+ 3424us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.65:55301: BlockingRecv error: recv got EOF from 127.25.103.65:55301 (error 108)
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":108,"threads_started":1}
Aug 12 00:00:52 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:52 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:52.110297 8139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:52.104734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:53885)
0812 00:00:52.104968 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:52.104980 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:52.105068 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:52.105429 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:52.105431 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:52.105708 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:52.105786 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:52.105788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:52.106633 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:52.106635 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:52.107197 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:52.107199 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:52.107548 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:52.107550 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:52.107604 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:52.108229 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:52.108237 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:52.110188 (+ 1951us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":120,"threads_started":1}
W20260812 00:00:52.110395 8138 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:52.104879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:53885 (local address 127.25.103.126:35039)
0812 00:00:52.104942 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:52.104944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:52.105177 (+ 233us) server_negotiation.cc:407] Connection header received
0812 00:00:52.105227 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:52.105228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:52.105244 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:52.105357 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:52.105921 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:52.106546 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:52.107282 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:52.107485 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:52.107543 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:52.110336 (+ 2793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.66:53885: BlockingRecv error: recv got EOF from 127.25.103.66:53885 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 12 00:00:52 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:52 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:52.236760 8142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:52.231119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.67:54467)
0812 00:00:52.231267 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:52.231277 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:52.231363 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:52.231502 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:52.231502 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:52.231712 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:52.231773 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:52.231775 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:52.232528 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:52.232529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:52.233108 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:52.233110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:52.233550 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:52.233551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:52.233605 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:52.234158 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:52.234166 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:52.236689 (+ 2523us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":74,"threads_started":1}
W20260812 00:00:52.236886 8138 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:52.231153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:54467 (local address 127.25.103.126:35039)
0812 00:00:52.231204 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:52.231206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:52.231358 (+ 152us) server_negotiation.cc:407] Connection header received
0812 00:00:52.231418 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:52.231419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:52.231436 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:52.231491 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:52.231874 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:52.232419 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:52.233249 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:52.233437 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:52.233502 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:52.236819 (+ 3317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.67:54467: BlockingRecv error: recv got EOF from 127.25.103.67:54467 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 12 00:00:52 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:52 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:52.976311 8143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:52.970624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:33497)
0812 00:00:52.970796 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:52.970811 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:52.970897 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:52.971130 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:52.971131 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:52.971315 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:52.971373 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:52.971375 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:52.972171 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:52.972172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:52.972746 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:52.972747 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:52.973134 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:52.973135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:52.973186 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:52.973749 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:52.973758 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:52.976241 (+ 2483us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":89,"threads_started":1}
W20260812 00:00:52.976518 8144 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:52.970785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:33497 (local address 127.25.103.126:35039)
0812 00:00:52.970962 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:52.970964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:52.970974 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:00:52.971004 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:52.971005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:52.971017 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:52.971087 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:52.971566 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:52.972089 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:52.972840 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:52.973059 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:52.973114 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:52.976428 (+ 3314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.65:33497: BlockingRecv error: recv got EOF from 127.25.103.65:33497 (error 108)
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":82,"threads_started":1}
Aug 12 00:00:53 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:53 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:53.116868 8145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:53.111064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:51685)
0812 00:00:53.111231 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:53.111245 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:53.111331 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:53.111718 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:53.111721 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:53.111963 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:53.112034 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:53.112036 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:53.112959 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:53.112960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:53.113520 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:53.113522 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:53.113992 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:53.113994 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:53.114187 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:53.114872 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:53.114878 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:53.116803 (+ 1925us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
W20260812 00:00:53.117048 8144 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:53.111194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:51685 (local address 127.25.103.126:35039)
0812 00:00:53.111320 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:53.111322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:53.111335 (+ 13us) server_negotiation.cc:407] Connection header received
0812 00:00:53.111406 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:53.111408 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:53.111422 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:53.111658 (+ 236us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:53.112126 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:53.112789 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:53.113612 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:53.113821 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:53.113894 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:53.116968 (+ 3074us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.66:51685: BlockingRecv error: recv got EOF from 127.25.103.66:51685 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 12 00:00:53 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:53 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:53.243000 8146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:53.237324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.67:51899)
0812 00:00:53.237477 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:53.237488 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:53.237546 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:53.237742 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:53.237743 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:53.237932 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:53.238162 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:53.238166 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:53.238865 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:53.238866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:53.239394 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:53.239395 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:53.239792 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:53.239793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:53.239864 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:53.240424 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:53.240429 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:53.242914 (+ 2485us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":80,"threads_started":1}
W20260812 00:00:53.243167 8144 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:53.237520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:51899 (local address 127.25.103.126:35039)
0812 00:00:53.237612 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:53.237614 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:53.237625 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:00:53.237657 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:53.237658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:53.237676 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:53.237725 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:53.238274 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:53.238787 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:53.239474 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:53.239689 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:53.239756 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:53.243071 (+ 3315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.67:51899: BlockingRecv error: recv got EOF from 127.25.103.67:51899 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 00:00:53 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:53 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:53.984169 8148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:53.977004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:58693)
0812 00:00:53.977232 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:53.977247 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:53.977322 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:53.977498 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:53.977499 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:53.977683 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:53.977742 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:53.977744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:53.978912 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:53.978914 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:53.979719 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:53.979724 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:53.980409 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:53.980411 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:53.980488 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:53.981130 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:53.981135 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:53.984090 (+ 2955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":88,"threads_started":1}
W20260812 00:00:53.984427 8149 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:53.977183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:58693 (local address 127.25.103.126:35039)
0812 00:00:53.977334 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:53.977335 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:53.977346 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:00:53.977374 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:53.977375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:53.977387 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:53.977475 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:53.977898 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:53.978741 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:53.979891 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:53.980257 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:53.980351 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:53.984339 (+ 3988us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.65:58693: BlockingRecv error: recv got EOF from 127.25.103.65:58693 (error 108)
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":67,"threads_started":1}
Aug 12 00:00:54 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:54 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:54.124229 8150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:54.117809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:41091)
0812 00:00:54.118419 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:54.118432 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:54.118502 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:54.118764 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:54.118765 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:54.118940 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:54.119013 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:54.119016 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:54.120203 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:54.120204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:54.120743 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:54.120744 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:54.121317 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:54.121318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:54.121366 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:54.121908 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:54.121914 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:54.124138 (+ 2224us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":108,"threads_started":1}
W20260812 00:00:54.124351 8149 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:54.118399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:41091 (local address 127.25.103.126:35039)
0812 00:00:54.118556 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:54.118559 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:54.118578 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:00:54.118620 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:54.118622 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:54.118657 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:54.118746 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:54.119123 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:54.120110 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:54.120843 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:54.121232 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:54.121304 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:54.124278 (+ 2974us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.66:41091: BlockingRecv error: recv got EOF from 127.25.103.66:41091 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 12 00:00:54 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:54 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:54.249377 8152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:54.243686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.67:58751)
0812 00:00:54.243862 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:54.243875 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:54.243951 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:54.244236 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:54.244238 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:54.244468 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:54.244548 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:54.244550 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:54.245443 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:54.245444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:54.246130 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:54.246132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:54.246643 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:54.246645 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:54.246715 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:54.247244 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:54.247249 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:54.249282 (+ 2033us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":75,"threads_started":1}
W20260812 00:00:54.249475 8149 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:54.243799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:58751 (local address 127.25.103.126:35039)
0812 00:00:54.243867 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:54.243869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:54.243999 (+ 130us) server_negotiation.cc:407] Connection header received
0812 00:00:54.244045 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:54.244046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:54.244067 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:54.244139 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:54.244676 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:54.245313 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:54.246281 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:54.246503 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:54.246577 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:54.249406 (+ 2829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.67:58751: BlockingRecv error: recv got EOF from 127.25.103.67:58751 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 12 00:00:54 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:54 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:54.991240 8153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:54.984840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:56919)
0812 00:00:54.985035 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:54.985049 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:54.985125 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:54.985575 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:54.985577 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:54.985769 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:54.985826 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:54.985828 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:54.986783 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:54.986785 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:54.987371 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:54.987374 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:54.987933 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:54.987935 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:54.988012 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:54.988609 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:54.988615 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:54.991169 (+ 2554us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":83,"threads_started":1}
W20260812 00:00:54.991475 8154 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:54.985005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:56919 (local address 127.25.103.126:35039)
0812 00:00:54.985325 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:54.985327 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:54.985339 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:00:54.985367 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:54.985368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:54.985393 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:54.985474 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:54.985983 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:54.986649 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:54.987526 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:54.987790 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:54.987881 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:54.991397 (+ 3516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.65:56919: BlockingRecv error: recv got EOF from 127.25.103.65:56919 (error 108)
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":148,"threads_started":1}
Aug 12 00:00:55 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:55 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:55.131418 8158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:55.124957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:53273)
0812 00:00:55.125168 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:55.125181 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:55.125244 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:55.125446 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:55.125447 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:55.125670 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:55.125745 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:55.125747 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:55.126575 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:55.126577 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:55.127301 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:55.127306 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:55.127878 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:55.127879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:55.127954 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:55.128525 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:55.128530 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:55.131336 (+ 2806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":126,"threads_started":1}
W20260812 00:00:55.131625 8154 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:55.125204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:53273 (local address 127.25.103.126:35039)
0812 00:00:55.125276 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:55.125278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:55.125290 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:00:55.125325 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:55.125326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:55.125339 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:55.125425 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:55.125845 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:55.126420 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:55.127476 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:55.127719 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:55.127797 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:55.131551 (+ 3754us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.66:53273: BlockingRecv error: recv got EOF from 127.25.103.66:53273 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 00:00:55 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:55 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:55.255410 8163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:55.250156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.67:56191)
0812 00:00:55.250328 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:55.250342 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:55.250439 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:55.250586 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:55.250587 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:55.250799 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:55.250855 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:55.250857 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:55.251531 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:55.251532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:55.252063 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:55.252064 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:55.252404 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:55.252405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:55.252457 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:55.252926 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:55.252932 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:55.255292 (+ 2360us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":81,"threads_started":1}
W20260812 00:00:55.255493 8154 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:55.250319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:56191 (local address 127.25.103.126:35039)
0812 00:00:55.250399 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:55.250401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:55.250415 (+ 14us) server_negotiation.cc:407] Connection header received
0812 00:00:55.250510 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:55.250512 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:55.250527 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:55.250571 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:55.250939 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:55.251454 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:55.252151 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:55.252340 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:55.252397 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:55.255428 (+ 3031us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.67:56191: BlockingRecv error: recv got EOF from 127.25.103.67:56191 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 00:00:56 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:56 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:56.004179 8164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:55.991886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:47001)
0812 00:00:55.992084 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:55.992095 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:55.992148 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:55.992283 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:55.992283 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:55.992469 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:55.992527 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:55.992529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:55.993349 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:55.993350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:55.993990 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:55.993993 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:55.994489 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:55.994492 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:55.994607 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:56.001031 (+ 6424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:56.001051 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:56.004099 (+ 3048us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":104,"threads_started":1}
W20260812 00:00:56.004503 8166 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:55.992007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:47001 (local address 127.25.103.126:35039)
0812 00:00:55.992138 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:55.992140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:55.992149 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:55.992198 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:55.992199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:55.992210 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:55.992271 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:55.992611 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:55.993151 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:55.994099 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:55.994307 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:55.994366 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:56.004320 (+ 9954us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.65:47001: BlockingRecv error: recv got EOF from 127.25.103.65:47001 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
Aug 12 00:00:56 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:56 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:56.137563 8167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:56.132160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:36625)
0812 00:00:56.132414 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:56.132428 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:56.132520 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:56.132669 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:56.132670 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:56.132865 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:56.132919 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:56.132921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:56.133601 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:56.133602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:56.134195 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:56.134197 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:56.134539 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:56.134539 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:56.134590 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:56.135138 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:56.135146 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:56.137450 (+ 2304us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":101,"threads_started":1}
W20260812 00:00:56.137684 8166 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:56.132284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:36625 (local address 127.25.103.126:35039)
0812 00:00:56.132402 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:56.132405 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:56.132507 (+ 102us) server_negotiation.cc:407] Connection header received
0812 00:00:56.132586 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:56.132587 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:56.132603 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:56.132655 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:56.132999 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:56.133508 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:56.134274 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:56.134470 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:56.134536 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:56.137615 (+ 3079us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.66:36625: BlockingRecv error: recv got EOF from 127.25.103.66:36625 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 12 00:00:56 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:56 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:56.261812 8168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:56.256121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.67:48937)
0812 00:00:56.256367 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:56.256387 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:56.256460 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:56.256605 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:56.256606 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:56.256782 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:56.256834 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:56.256835 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:56.257526 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:56.257527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:56.258169 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:56.258172 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:56.258753 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:56.258754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:56.258811 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:56.259418 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:56.259424 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:56.261710 (+ 2286us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":81,"threads_started":1}
W20260812 00:00:56.261984 8166 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:56.256282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:48937 (local address 127.25.103.126:35039)
0812 00:00:56.256367 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:56.256369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:56.256441 (+ 72us) server_negotiation.cc:407] Connection header received
0812 00:00:56.256509 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:56.256510 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:56.256525 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:56.256600 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:56.256899 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:56.257424 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:56.258354 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:56.258620 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:56.258729 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:56.261868 (+ 3139us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.67:48937: BlockingRecv error: recv got EOF from 127.25.103.67:48937 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 00:00:57 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:57 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:57.010275 8169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:57.004862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:41701)
0812 00:00:57.004997 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:57.005009 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:57.005065 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:57.005268 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:57.005268 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:57.005460 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:57.005513 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:57.005515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:57.006462 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:57.006464 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:57.007067 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:57.007069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:57.007537 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:57.007538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:57.007643 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:57.008175 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:57.008179 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:57.010191 (+ 2012us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":79,"threads_started":1}
W20260812 00:00:57.010412 8170 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:57.004978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:41701 (local address 127.25.103.126:35039)
0812 00:00:57.005140 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:57.005142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:57.005151 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:57.005176 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:57.005177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:57.005188 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:57.005254 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:57.005635 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:57.006285 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:57.007195 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:57.007415 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:57.007483 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:57.010332 (+ 2849us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.65:41701: BlockingRecv error: recv got EOF from 127.25.103.65:41701 (error 108)
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":70,"threads_started":1}
Aug 12 00:00:57 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:57 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:57.144395 8174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:57.138209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:48009)
0812 00:00:57.138378 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:57.138391 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:57.138467 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:57.138620 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:57.138620 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:57.138806 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:57.138858 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:57.138859 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:57.139867 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:57.139868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:57.140628 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:57.140631 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:57.141185 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:57.141186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:57.141240 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:57.141923 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:57.141929 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:57.144312 (+ 2383us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":72,"threads_started":1}
W20260812 00:00:57.144559 8170 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:57.138328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:48009 (local address 127.25.103.126:35039)
0812 00:00:57.138395 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:57.138396 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:57.138465 (+ 69us) server_negotiation.cc:407] Connection header received
0812 00:00:57.138529 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:57.138530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:57.138549 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:57.138595 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:57.139034 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:57.139717 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:57.140781 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:57.141077 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:57.141160 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:57.144474 (+ 3314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.66:48009: BlockingRecv error: recv got EOF from 127.25.103.66:48009 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 12 00:00:57 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:57 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:57.268229 8176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:57.262688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.67:43547)
0812 00:00:57.262881 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:57.262896 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:57.262986 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:57.263160 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:57.263161 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:57.263408 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:57.263478 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:57.263480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:57.264233 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:57.264234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:57.264783 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:57.264784 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:57.265133 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:57.265134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:57.265188 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:57.265734 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:57.265745 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:57.268126 (+ 2381us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":98,"threads_started":1}
W20260812 00:00:57.268450 8170 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:57.262863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:43547 (local address 127.25.103.126:35039)
0812 00:00:57.262958 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:57.262961 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:57.262976 (+ 15us) server_negotiation.cc:407] Connection header received
0812 00:00:57.263067 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:57.263068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:57.263089 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:57.263151 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:57.263563 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:57.264150 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:57.264865 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:57.265053 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:57.265112 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:57.268382 (+ 3270us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.67:43547: BlockingRecv error: recv got EOF from 127.25.103.67:43547 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 12 00:00:58 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:58 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:58.015955 8179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:58.010841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:32861)
0812 00:00:58.011056 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:58.011072 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:58.011155 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:58.011417 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:58.011420 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:58.011619 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:58.011680 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:58.011682 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:58.012511 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:58.012512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:58.013056 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:58.013058 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:58.013490 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:58.013491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:58.013539 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:58.014111 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:58.014117 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:58.015872 (+ 1755us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":72,"threads_started":1}
W20260812 00:00:58.016230 8180 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:58.011031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:32861 (local address 127.25.103.126:35039)
0812 00:00:58.011160 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:58.011163 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:58.011175 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:00:58.011210 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:58.011211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:58.011222 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:58.011295 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:58.011803 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:58.012383 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:58.013157 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:58.013363 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:58.013455 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:58.016125 (+ 2670us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.65:32861: BlockingRecv error: recv got EOF from 127.25.103.65:32861 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":52,"threads_started":1}
Aug 12 00:00:58 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:58 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:58.150337 8181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:58.144977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:39211)
0812 00:00:58.145146 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:58.145158 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:58.145232 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:58.145431 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:58.145433 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:58.145674 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:58.145753 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:58.145756 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:58.146552 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:58.146553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:58.147163 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:58.147165 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:58.147610 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:58.147611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:58.147689 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:58.148221 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:58.148227 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:58.150265 (+ 2038us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":76,"threads_started":1}
W20260812 00:00:58.150540 8180 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:58.145109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:39211 (local address 127.25.103.126:35039)
0812 00:00:58.145174 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:58.145176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:58.145209 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:00:58.145291 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:58.145292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:58.145304 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:58.145354 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:58.145880 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:58.146436 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:58.147264 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:58.147483 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:58.147566 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:58.150455 (+ 2889us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.66:39211: BlockingRecv error: recv got EOF from 127.25.103.66:39211 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 12 00:00:58 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:58 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:58.274479 8182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:58.268950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.67:38501)
0812 00:00:58.269121 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:58.269133 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:58.269199 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:58.269346 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:58.269347 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:58.269799 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:58.269896 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:58.269900 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:58.270831 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:58.270833 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:58.271414 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:58.271416 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:58.271888 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:58.271889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:58.271941 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:58.272425 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:58.272430 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:58.274408 (+ 1978us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":90,"threads_started":1}
W20260812 00:00:58.274662 8180 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:58.269055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:38501 (local address 127.25.103.126:35039)
0812 00:00:58.269111 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:58.269113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:58.269190 (+ 77us) server_negotiation.cc:407] Connection header received
0812 00:00:58.269252 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:58.269253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:58.269269 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:58.269333 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:58.270089 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:58.270702 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:58.271553 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:58.271756 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:58.271815 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:58.274602 (+ 2787us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.67:38501: BlockingRecv error: recv got EOF from 127.25.103.67:38501 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 12 00:00:59 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:59 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:59.022751 8186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:59.016619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:53099)
0812 00:00:59.016765 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:59.016776 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:59.016847 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:59.017011 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:59.017012 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:59.017204 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:59.017259 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:59.017261 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:59.018193 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:59.018196 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:59.018895 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:59.018898 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:59.019385 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:59.019388 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:59.019467 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:59.020008 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:59.020014 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:59.022672 (+ 2658us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":90,"threads_started":1}
W20260812 00:00:59.022924 8185 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:59.016641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:53099 (local address 127.25.103.126:35039)
0812 00:00:59.016791 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:59.016793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:59.016828 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:00:59.016899 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:59.016900 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:59.016913 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:59.016994 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:59.017361 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:59.017997 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:59.019005 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:59.019221 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:59.019342 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:59.022837 (+ 3495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.65:53099: BlockingRecv error: recv got EOF from 127.25.103.65:53099 (error 108)
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":71,"threads_started":1}
Aug 12 00:00:59 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:59 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:59.156169 8187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:59.151100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:48995)
0812 00:00:59.151294 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:59.151307 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:59.151387 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:59.151535 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:59.151535 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:59.151736 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:59.151788 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:59.151789 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:59.152470 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:59.152471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:59.153001 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:59.153003 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:59.153341 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:59.153342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:59.153395 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:59.154012 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:59.154017 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:59.156103 (+ 2086us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":73,"threads_started":1}
W20260812 00:00:59.156353 8185 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:59.151315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:48995 (local address 127.25.103.126:35039)
0812 00:00:59.151385 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:59.151387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:59.151396 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:00:59.151455 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:59.151456 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:59.151468 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:59.151515 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:59.151865 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:59.152382 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:59.153089 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:59.153274 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:59.153330 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:59.156286 (+ 2956us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.66:48995: BlockingRecv error: recv got EOF from 127.25.103.66:48995 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 12 00:00:59 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:00:59 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:00:59.280246 8190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:00:59.275007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.67:49549)
0812 00:00:59.275185 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:00:59.275200 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:00:59.275288 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:00:59.275435 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:00:59.275436 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:00:59.275691 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:00:59.275746 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:59.275749 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:59.276468 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:59.276469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:59.277058 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:00:59.277060 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:00:59.277385 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:00:59.277386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:00:59.277444 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:59.277993 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:00:59.277998 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:00:59.280156 (+ 2158us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":86,"threads_started":1}
W20260812 00:00:59.280423 8185 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:00:59.275122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:49549 (local address 127.25.103.126:35039)
0812 00:00:59.275201 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0812 00:00:59.275203 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:00:59.275272 (+ 69us) server_negotiation.cc:407] Connection header received
0812 00:00:59.275350 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:00:59.275351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:00:59.275367 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:00:59.275424 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:00:59.275864 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:59.276389 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:59.277132 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:00:59.277325 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:00:59.277380 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:00:59.280355 (+ 2975us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.67:49549: BlockingRecv error: recv got EOF from 127.25.103.67:49549 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 00:01:00 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:01:00 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:01:00.029307 8191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:00.023540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:42329)
0812 00:01:00.023682 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:00.023692 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:00.023752 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:00.023934 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:00.023935 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:00.024128 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:00.024181 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:00.024183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:00.025025 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:00.025026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:00.025607 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:00.025608 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:00.026119 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:00.026120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:00.026179 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:00.026790 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:00.026795 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:00.029241 (+ 2446us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":66,"threads_started":1}
W20260812 00:01:00.029430 8192 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:01:00.023575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:42329 (local address 127.25.103.126:35039)
0812 00:01:00.023762 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:00.023764 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:00.023792 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:01:00.023818 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:00.023818 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:00.023831 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:00.023889 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:00.024276 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:00.024908 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:00.025723 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:00.025928 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:00.026013 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:00.029355 (+ 3342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.65:42329: BlockingRecv error: recv got EOF from 127.25.103.65:42329 (error 108)
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":73,"threads_started":1}
Aug 12 00:01:00 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:01:00 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:01:00.162856 8193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:00.156798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:33161)
0812 00:01:00.156958 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:00.156969 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:00.157032 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:00.157216 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:00.157223 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:00.157411 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:00.157465 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:00.157467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:00.158351 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:00.158352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:00.159257 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:00.159260 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:00.159872 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:00.159873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:00.159932 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:00.160548 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:00.160554 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:00.162774 (+ 2220us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":72,"threads_started":1}
W20260812 00:01:00.162935 8192 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:01:00.156923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:33161 (local address 127.25.103.126:35039)
0812 00:01:00.156974 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:00.156976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:00.157017 (+ 41us) server_negotiation.cc:407] Connection header received
0812 00:01:00.157082 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:00.157083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:00.157093 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:00.157156 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:00.157595 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:00.158174 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:00.159333 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:00.159787 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:00.159863 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:00.162879 (+ 3016us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.66:33161: BlockingRecv error: recv got EOF from 127.25.103.66:33161 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 12 00:01:00 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:01:00 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.67@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:01:00.286238 8194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:00.280820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.67:35691)
0812 00:01:00.280974 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:00.280985 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:00.281054 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:00.281189 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:00.281190 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:00.281471 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:00.281524 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:00.281527 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:00.282308 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:00.282309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:00.282935 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:00.282938 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:00.283294 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:00.283295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:00.283345 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:00.283955 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:00.283960 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:00.286154 (+ 2194us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":88,"threads_started":1}
W20260812 00:01:00.286310 8192 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:01:00.280983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:35691 (local address 127.25.103.126:35039)
0812 00:01:00.281054 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:00.281056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:00.281065 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:01:00.281111 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:00.281112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:00.281126 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:00.281174 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:00.281668 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:00.282232 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:00.283044 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:00.283232 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:00.283288 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:00.286256 (+ 2968us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.67:35691: BlockingRecv error: recv got EOF from 127.25.103.67:35691 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 12 00:01:01 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:01:01 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.65@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:01:01.040433 8195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:01.030171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.65:44589)
0812 00:01:01.030394 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:01.030409 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:01.030494 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:01.030771 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:01.030774 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:01.031021 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:01.031090 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:01.031092 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.032102 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.032103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:01.032793 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:01.032801 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.033342 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.033343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:01.033428 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:01.037836 (+ 4408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:01.037843 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:01.040235 (+ 2392us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":89,"threads_started":1}
W20260812 00:01:01.040578 8196 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:01:01.030332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:44589 (local address 127.25.103.126:35039)
0812 00:01:01.030477 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:01.030479 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:01.030492 (+ 13us) server_negotiation.cc:407] Connection header received
0812 00:01:01.030569 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:01.030570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:01.030584 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:01.030658 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:01.031229 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.031990 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.033019 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.033242 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.033311 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:01.040426 (+ 7115us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.65:44589: BlockingRecv error: recv got EOF from 127.25.103.65:44589 (error 108)
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":67,"threads_started":1}
Aug 12 00:01:01 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:01:01 dist-test-slave-vpvm krb5kdc[6534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.103.66@KRBTEST.COM for oryx/127.25.103.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:01:01.173385 8198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:01.163609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:35039 (local address 127.25.103.66:57705)
0812 00:01:01.163836 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:01.163849 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:01.164062 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:01.164295 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:01.164296 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:01.164511 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:01.164580 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:01.164582 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.168157 (+ 3575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.168159 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:01.168929 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:01.168931 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.169934 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.169937 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:01.170137 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:01.170803 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:01.170810 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:01.173288 (+ 2478us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.103.126:35039: Server oryx/127.25.103.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":82,"threads_started":1}
W20260812 00:01:01.173552 8196 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:01:01.163723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:57705 (local address 127.25.103.126:35039)
0812 00:01:01.163794 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:01.163796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:01.163940 (+ 144us) server_negotiation.cc:407] Connection header received
0812 00:01:01.164145 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:01.164146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:01.164162 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:01.164222 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:01.164735 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.165753 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.169073 (+ 3320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.169534 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.169638 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:01.173477 (+ 3839us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.103.66:57705: BlockingRecv error: recv got EOF from 127.25.103.66:57705 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:01:01.196540 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 7452
I20260812 00:01:01.212363 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 7697
I20260812 00:01:01.229004 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 7900
I20260812 00:01:01.249395 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 7340
2026-08-12T00:01:01Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17953 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T00:01:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:01:01Z Disabled control of system clock
I20260812 00:01:01.299232 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:41683
--webserver_interface=127.25.103.126
--webserver_port=0
--builtin_ntp_servers=127.25.103.84:43205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:41683
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 00:01:01.397615 8205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:01.397857 8205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:01.397877 8205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:01.399366 8205 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:01:01.399434 8205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:01.399447 8205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:01.399459 8205 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:01:01.399470 8205 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:01:01.401019 8205 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:43205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:41683
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:41683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:01:01.401278 8205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:01.401571 8205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:01.406981 8212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:01.407028 8217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:01.407049 8215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:01.407102 8205 server_base.cc:1034] running on GCE node
I20260812 00:01:01.407887 8205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:01.408447 8205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:01.409680 8205 hybrid_clock.cc:648] HybridClock initialized: now 1786492861409631 us; error 72 us; skew 500 ppm
I20260812 00:01:01.411360 8205 webserver.cc:460] Webserver started at http://127.25.103.126:44091/ using document root <none> and password file <none>
I20260812 00:01:01.411615 8205 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:01.411665 8205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:01.411800 8205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:01.412982 8205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "6537e97fbd1a4c46a9c25fe5e96e61a5"
format_stamp: "Formatted at 2026-08-12 00:01:01 on dist-test-slave-vpvm"
server_key: "a5c5a7b39e20983edefc12948935d2b3"
server_key_iv: "fdc996464379806f9a0ce5d9f48a9b71"
server_key_version: "encryptionkey@0"
I20260812 00:01:01.413357 8205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "6537e97fbd1a4c46a9c25fe5e96e61a5"
format_stamp: "Formatted at 2026-08-12 00:01:01 on dist-test-slave-vpvm"
server_key: "a5c5a7b39e20983edefc12948935d2b3"
server_key_iv: "fdc996464379806f9a0ce5d9f48a9b71"
server_key_version: "encryptionkey@0"
I20260812 00:01:01.414826 8205 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:01:01.415828 8229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:01.416122 8205 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:01.416229 8205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "6537e97fbd1a4c46a9c25fe5e96e61a5"
format_stamp: "Formatted at 2026-08-12 00:01:01 on dist-test-slave-vpvm"
server_key: "a5c5a7b39e20983edefc12948935d2b3"
server_key_iv: "fdc996464379806f9a0ce5d9f48a9b71"
server_key_version: "encryptionkey@0"
I20260812 00:01:01.416306 8205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:01.454773 8205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:01.455258 8205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:01.455420 8205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:01.460330 8205 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:41683
I20260812 00:01:01.460379 8312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:41683 every 8 connection(s)
I20260812 00:01:01.460915 8205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:01:01.461714 8314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:01.464730 8314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5: Bootstrap starting.
I20260812 00:01:01.465428 8314 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:01.465751 8314 log.cc:824] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:01.466710 8314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5: No bootstrap required, opened a new log
I20260812 00:01:01.467326 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 8205
I20260812 00:01:01.467481 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:01:01.467705 26013 external_mini_cluster.cc:1428] Setting key 8fef8d99b40ab214f4d638bea31ff899
I20260812 00:01:01.469482 8314 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6537e97fbd1a4c46a9c25fe5e96e61a5" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 41683 } }
I20260812 00:01:01.469704 8314 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:01.469801 8314 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6537e97fbd1a4c46a9c25fe5e96e61a5, State: Initialized, Role: FOLLOWER
I20260812 00:01:01.470108 8314 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6537e97fbd1a4c46a9c25fe5e96e61a5" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 41683 } }
I20260812 00:01:01.470258 8314 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:01:01.470291 8314 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:01:01.470325 8314 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:01.471135 8314 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6537e97fbd1a4c46a9c25fe5e96e61a5" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 41683 } }
I20260812 00:01:01.471246 8314 leader_election.cc:302] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6537e97fbd1a4c46a9c25fe5e96e61a5; no voters:
I20260812 00:01:01.471457 8314 leader_election.cc:288] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:01:01.471505 8320 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:01.471649 8320 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5 [term 1 LEADER]: Becoming Leader. State: Replica: 6537e97fbd1a4c46a9c25fe5e96e61a5, State: Running, Role: LEADER
I20260812 00:01:01.471745 8320 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6537e97fbd1a4c46a9c25fe5e96e61a5" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 41683 } }
I20260812 00:01:01.471791 8314 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:01:01.473131 8322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6537e97fbd1a4c46a9c25fe5e96e61a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6537e97fbd1a4c46a9c25fe5e96e61a5" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 41683 } } }
I20260812 00:01:01.473275 8322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:01.473837 8323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6537e97fbd1a4c46a9c25fe5e96e61a5. Latest consensus state: current_term: 1 leader_uuid: "6537e97fbd1a4c46a9c25fe5e96e61a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6537e97fbd1a4c46a9c25fe5e96e61a5" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 41683 } } }
I20260812 00:01:01.474084 8323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:01.474025 8335 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:01:01.474728 8335 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:01:01.475756 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:01.468508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44994 (local address 127.25.103.126:41683)
0812 00:01:01.468826 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:01.468836 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:01.468871 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:01:01.469481 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:01.469496 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:01.469615 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:01.469861 (+ 246us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:01.470235 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.472075 (+ 1840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.473415 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.474151 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.474297 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:01.475041 (+ 744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:01.475046 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:01.475047 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:01:01.475250 (+ 203us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:01.475288 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:01:01.475300 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:01.475359 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:01.475450 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 00:01:01.475545 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":143,"threads_started":1}
I20260812 00:01:01.476692 8335 catalog_manager.cc:1347] Generated new cluster ID: b763212bdc284ef9acef1bd065918c56
I20260812 00:01:01.476758 8335 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:01:01.486768 8335 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:01:01.487375 8335 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:01:01.490746 8335 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6537e97fbd1a4c46a9c25fe5e96e61a5: Generated new TSK 0
I20260812 00:01:01.490957 8335 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:01:01.493249 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:41683
--builtin_ntp_servers=127.25.103.84:43205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 00:01:01.620594 8347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:01.620838 8347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:01.620867 8347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:01.622385 8347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:01.622447 8347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:01.622476 8347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:01:01.624053 8347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:43205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:41683
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:01:01.624333 8347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:01.624675 8347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:01.630178 8359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:01.630219 8353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:01.630373 8347 server_base.cc:1034] running on GCE node
W20260812 00:01:01.630182 8362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:01.630741 8347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:01.631037 8347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:01.632253 8347 hybrid_clock.cc:648] HybridClock initialized: now 1786492861632233 us; error 36 us; skew 500 ppm
I20260812 00:01:01.634387 8347 webserver.cc:460] Webserver started at http://127.25.103.65:38063/ using document root <none> and password file <none>
I20260812 00:01:01.634725 8347 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:01.634788 8347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:01.634953 8347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:01.636335 8347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "8eb91b44caf54d178e251ffbec9cd124"
format_stamp: "Formatted at 2026-08-12 00:01:01 on dist-test-slave-vpvm"
server_key: "46076d6495d69550644ce05eec5bd642"
server_key_iv: "407d369a3ffd42c5563cafe610c3120f"
server_key_version: "encryptionkey@0"
I20260812 00:01:01.636744 8347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "8eb91b44caf54d178e251ffbec9cd124"
format_stamp: "Formatted at 2026-08-12 00:01:01 on dist-test-slave-vpvm"
server_key: "46076d6495d69550644ce05eec5bd642"
server_key_iv: "407d369a3ffd42c5563cafe610c3120f"
server_key_version: "encryptionkey@0"
I20260812 00:01:01.638352 8347 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260812 00:01:01.639216 8369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:01.639417 8347 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:01.639675 8347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "8eb91b44caf54d178e251ffbec9cd124"
format_stamp: "Formatted at 2026-08-12 00:01:01 on dist-test-slave-vpvm"
server_key: "46076d6495d69550644ce05eec5bd642"
server_key_iv: "407d369a3ffd42c5563cafe610c3120f"
server_key_version: "encryptionkey@0"
I20260812 00:01:01.639873 8347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:01.652678 8347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:01.653055 8347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:01.653191 8347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:01.653445 8347 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:01.653829 8347 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:01.653865 8347 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:01.653898 8347 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:01.653913 8347 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:01.660894 8347 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:41903
I20260812 00:01:01.660945 8553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:41903 every 8 connection(s)
I20260812 00:01:01.661299 8347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:01:01.661875 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 8347
I20260812 00:01:01.661975 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:01:01.662180 26013 external_mini_cluster.cc:1428] Setting key 6c2d474ebffcbf7a4e66ca74c671fc68
I20260812 00:01:01.663451 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:41683
--builtin_ntp_servers=127.25.103.84:43205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 00:01:01.668566 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:01.662167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:51785 (local address 127.25.103.126:41683)
0812 00:01:01.662247 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:01.662250 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:01.662464 (+ 214us) server_negotiation.cc:407] Connection header received
0812 00:01:01.663146 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:01.663147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:01.663161 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:01.663324 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:01.664134 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.665103 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.666400 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.666756 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.666893 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:01.668121 (+ 1228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:01.668123 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:01.668124 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:01:01.668132 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:01.668159 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:01:01.668165 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:01.668226 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:01.668297 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 00:01:01.668351 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:01:01.668778 8559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:01.662144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:41683 (local address 127.25.103.65:51785)
0812 00:01:01.662347 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:01.662390 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:01.663020 (+ 630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:01.663423 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:01.663427 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:01.663437 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:01.663949 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:01.663954 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.665270 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.665272 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:01.666283 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:01.666287 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.666935 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.666936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:01.667171 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:01.667922 (+ 751us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:01:01.667923 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:01.667960 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:01:01.668003 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:01.668232 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:01.668235 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:01.668237 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:01:01.668287 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 00:01:01.668394 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":83,"threads_started":1}
I20260812 00:01:01.669363 8554 heartbeater.cc:347] Connected to a master server at 127.25.103.126:41683
I20260812 00:01:01.669477 8554 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:01.669689 8554 heartbeater.cc:511] Master 127.25.103.126:41683 requested a full tablet report, sending...
I20260812 00:01:01.670249 8256 ts_manager.cc:194] Registered new tserver with Master: 8eb91b44caf54d178e251ffbec9cd124 (127.25.103.65:41903)
I20260812 00:01:01.670943 8256 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.103.65:51785
W20260812 00:01:01.766004 8562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:01.766325 8562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:01.766361 8562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:01.767676 8562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:01.767724 8562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:01.767762 8562 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:01:01.770327 8562 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:43205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:41683
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:01:01.770699 8562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:01.771064 8562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:01.777513 8572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:01.777518 8569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:01.777513 8568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:01.777555 8562 server_base.cc:1034] running on GCE node
I20260812 00:01:01.778091 8562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:01.778381 8562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:01.779577 8562 hybrid_clock.cc:648] HybridClock initialized: now 1786492861779562 us; error 43 us; skew 500 ppm
I20260812 00:01:01.781090 8562 webserver.cc:460] Webserver started at http://127.25.103.66:38677/ using document root <none> and password file <none>
I20260812 00:01:01.781345 8562 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:01.781401 8562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:01.781551 8562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:01.782866 8562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "1d5ed2f01cee4234959a0c8c04bc38cb"
format_stamp: "Formatted at 2026-08-12 00:01:01 on dist-test-slave-vpvm"
server_key: "cfdf70d92f7b97a071fff9ab0de62d8d"
server_key_iv: "51cdbadaf754b66f26ed5e7cac05151d"
server_key_version: "encryptionkey@0"
I20260812 00:01:01.783289 8562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "1d5ed2f01cee4234959a0c8c04bc38cb"
format_stamp: "Formatted at 2026-08-12 00:01:01 on dist-test-slave-vpvm"
server_key: "cfdf70d92f7b97a071fff9ab0de62d8d"
server_key_iv: "51cdbadaf754b66f26ed5e7cac05151d"
server_key_version: "encryptionkey@0"
I20260812 00:01:01.784826 8562 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:01:01.785944 8580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:01.786161 8562 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:01.786262 8562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "1d5ed2f01cee4234959a0c8c04bc38cb"
format_stamp: "Formatted at 2026-08-12 00:01:01 on dist-test-slave-vpvm"
server_key: "cfdf70d92f7b97a071fff9ab0de62d8d"
server_key_iv: "51cdbadaf754b66f26ed5e7cac05151d"
server_key_version: "encryptionkey@0"
I20260812 00:01:01.786343 8562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:01.797680 8562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:01.798265 8562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:01.798466 8562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:01.798924 8562 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:01.799382 8562 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:01.799425 8562 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:01.799459 8562 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:01.799476 8562 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:01.805665 8562 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:38325
I20260812 00:01:01.805737 8753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:38325 every 8 connection(s)
I20260812 00:01:01.806180 8562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:01:01.813019 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 8562
I20260812 00:01:01.813146 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:01:01.813349 26013 external_mini_cluster.cc:1428] Setting key e5f55af30551bd8a5bd5d38127cc07a7
I20260812 00:01:01.813747 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:01.807390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:32857 (local address 127.25.103.126:41683)
0812 00:01:01.807528 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:01.807531 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:01.807807 (+ 276us) server_negotiation.cc:407] Connection header received
0812 00:01:01.808493 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:01.808495 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:01.808515 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:01.808607 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:01.809563 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.810279 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.811644 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.811871 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.811966 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:01.813347 (+ 1381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:01.813349 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:01.813350 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:01:01.813359 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:01.813388 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:01:01.813394 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:01.813471 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:01.813601 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 00:01:01.813661 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 00:01:01.814043 8757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:01.807334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:41683 (local address 127.25.103.66:32857)
0812 00:01:01.807616 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:01.807668 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:01.808335 (+ 667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:01.808780 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:01.808786 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:01.808799 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:01.809412 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:01.809419 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.810427 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.810430 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:01.811521 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:01.811527 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.812085 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.812087 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:01.812321 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:01.813052 (+ 731us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:01:01.813053 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:01.813103 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:01:01.813146 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:01.813511 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:01.813519 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:01.813524 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:01:01.813609 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 00:01:01.813760 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":134,"threads_started":1}
I20260812 00:01:01.814368 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:41683
--builtin_ntp_servers=127.25.103.84:43205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 00:01:01.814559 8755 heartbeater.cc:347] Connected to a master server at 127.25.103.126:41683
I20260812 00:01:01.814669 8755 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:01.814872 8755 heartbeater.cc:511] Master 127.25.103.126:41683 requested a full tablet report, sending...
I20260812 00:01:01.815274 8256 ts_manager.cc:194] Registered new tserver with Master: 1d5ed2f01cee4234959a0c8c04bc38cb (127.25.103.66:38325)
I20260812 00:01:01.815761 8256 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.103.66:32857
W20260812 00:01:01.907964 8758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:01.908226 8758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:01.908252 8758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:01.910416 8758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:01.910578 8758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:01.910629 8758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:01:01.912973 8758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:43205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:41683
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:01:01.913430 8758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:01.913865 8758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:01.920154 8769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:01.920166 8764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:01.920173 8771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:01.920560 8758 server_base.cc:1034] running on GCE node
I20260812 00:01:01.920843 8758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:01.921113 8758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:01.922310 8758 hybrid_clock.cc:648] HybridClock initialized: now 1786492861922292 us; error 37 us; skew 500 ppm
I20260812 00:01:01.924234 8758 webserver.cc:460] Webserver started at http://127.25.103.67:38529/ using document root <none> and password file <none>
I20260812 00:01:01.924510 8758 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:01.924566 8758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:01.924676 8758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:01.925869 8758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "a61eeb9bbbe34b53913ca6edd6a9d858"
format_stamp: "Formatted at 2026-08-12 00:01:01 on dist-test-slave-vpvm"
server_key: "3a36771d9d5013c14427a817604803da"
server_key_iv: "c8538cfe29c3ae63584f205842b38b36"
server_key_version: "encryptionkey@0"
I20260812 00:01:01.926316 8758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "a61eeb9bbbe34b53913ca6edd6a9d858"
format_stamp: "Formatted at 2026-08-12 00:01:01 on dist-test-slave-vpvm"
server_key: "3a36771d9d5013c14427a817604803da"
server_key_iv: "c8538cfe29c3ae63584f205842b38b36"
server_key_version: "encryptionkey@0"
I20260812 00:01:01.927990 8758 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260812 00:01:01.929095 8780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:01.929420 8758 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:01.929553 8758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "a61eeb9bbbe34b53913ca6edd6a9d858"
format_stamp: "Formatted at 2026-08-12 00:01:01 on dist-test-slave-vpvm"
server_key: "3a36771d9d5013c14427a817604803da"
server_key_iv: "c8538cfe29c3ae63584f205842b38b36"
server_key_version: "encryptionkey@0"
I20260812 00:01:01.929661 8758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:01.950464 8758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:01.950839 8758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:01.951113 8758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:01.951406 8758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:01.951825 8758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:01.951869 8758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:01.951903 8758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:01.951920 8758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:01.958668 8758 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:36317
I20260812 00:01:01.958719 8970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:36317 every 8 connection(s)
I20260812 00:01:01.959091 8758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:01:01.962147 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 8758
I20260812 00:01:01.962241 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:01:01.962409 26013 external_mini_cluster.cc:1428] Setting key 101c5d37b77a39eb6e0d823d4a6229f0
I20260812 00:01:01.966966 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:01.960040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:41125 (local address 127.25.103.126:41683)
0812 00:01:01.960194 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:01.960197 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:01.960712 (+ 515us) server_negotiation.cc:407] Connection header received
0812 00:01:01.961337 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:01.961339 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:01.961353 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:01.961422 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:01.962693 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.963427 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.964906 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.965138 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.965212 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:01.966632 (+ 1420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:01.966634 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:01.966634 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:01:01.966641 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:01.966662 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:01:01.966667 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:01.966736 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:01.966848 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 00:01:01.966895 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 00:01:01.967172 8973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:01.960050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:41683 (local address 127.25.103.67:41125)
0812 00:01:01.960478 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:01.960530 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:01.961185 (+ 655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:01.961623 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:01.961720 (+ 97us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:01.961736 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:01.962558 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:01.962571 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.963582 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.963583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:01.964738 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:01.964743 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:01.965311 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:01.965313 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:01.965554 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:01.966374 (+ 820us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:01:01.966374 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:01.966412 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:01:01.966443 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:01.966769 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:01.966775 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:01.966778 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:01:01.966843 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 00:01:01.966966 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":185,"threads_started":1}
I20260812 00:01:01.967824 8971 heartbeater.cc:347] Connected to a master server at 127.25.103.126:41683
I20260812 00:01:01.967928 8971 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:01.968130 8971 heartbeater.cc:511] Master 127.25.103.126:41683 requested a full tablet report, sending...
I20260812 00:01:01.968640 8256 ts_manager.cc:194] Registered new tserver with Master: a61eeb9bbbe34b53913ca6edd6a9d858 (127.25.103.67:36317)
I20260812 00:01:01.969027 8256 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.103.67:41125
I20260812 00:01:01.975672 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 00:01:01.978457 8318 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:01:01.977574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45004 (local address 127.25.103.126:41683)
0812 00:01:01.977669 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:01.977671 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:01.977682 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:01:01.977734 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:01.977734 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:01.977745 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:01.977806 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:01.978339 (+ 533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45004: BlockingRecv error: recv got EOF from 127.0.0.1:45004 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 00:01:01.978528 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 8347
I20260812 00:01:01.987845 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 8562
I20260812 00:01:02.002938 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 8758
I20260812 00:01:02.018376 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 8205
2026-08-12T00:01:02Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (762 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T00:01:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:01:02Z Disabled control of system clock
I20260812 00:01:02.060098 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:33995
--webserver_interface=127.25.103.126
--webserver_port=0
--builtin_ntp_servers=127.25.103.84:44719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:33995
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 00:01:02.157163 8987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:02.157459 8987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:02.157485 8987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:02.158869 8987 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:01:02.158929 8987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:02.158941 8987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:02.158953 8987 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:01:02.158964 8987 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:01:02.160506 8987 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:44719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:33995
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:33995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:01:02.161028 8987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:02.161541 8987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:01:02.167594 8987 server_base.cc:1034] running on GCE node
W20260812 00:01:02.167563 8997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:02.167622 8995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:02.167563 8994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:02.168220 8987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:02.168598 8987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:02.169797 8987 hybrid_clock.cc:648] HybridClock initialized: now 1786492862169778 us; error 39 us; skew 500 ppm
I20260812 00:01:02.171656 8987 webserver.cc:460] Webserver started at http://127.25.103.126:41711/ using document root <none> and password file <none>
I20260812 00:01:02.172031 8987 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:02.172209 8987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:02.172446 8987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:02.173666 8987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "021e902013aa44058e3ab9e4dfc84714"
format_stamp: "Formatted at 2026-08-12 00:01:02 on dist-test-slave-vpvm"
server_key: "d6397255490c5dd8aa3d6c69bac1c5d4"
server_key_iv: "dbf5d21bfae5359c66f4abce04c7b15a"
server_key_version: "encryptionkey@0"
I20260812 00:01:02.174108 8987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "021e902013aa44058e3ab9e4dfc84714"
format_stamp: "Formatted at 2026-08-12 00:01:02 on dist-test-slave-vpvm"
server_key: "d6397255490c5dd8aa3d6c69bac1c5d4"
server_key_iv: "dbf5d21bfae5359c66f4abce04c7b15a"
server_key_version: "encryptionkey@0"
I20260812 00:01:02.175640 8987 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:01:02.177109 9006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:02.177394 8987 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:02.177515 8987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "021e902013aa44058e3ab9e4dfc84714"
format_stamp: "Formatted at 2026-08-12 00:01:02 on dist-test-slave-vpvm"
server_key: "d6397255490c5dd8aa3d6c69bac1c5d4"
server_key_iv: "dbf5d21bfae5359c66f4abce04c7b15a"
server_key_version: "encryptionkey@0"
I20260812 00:01:02.177613 8987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:02.181694 8987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:02.182070 8987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:02.182219 8987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:02.186790 8987 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:33995
I20260812 00:01:02.186880 9087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:33995 every 8 connection(s)
I20260812 00:01:02.187234 8987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:01:02.187956 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 8987
I20260812 00:01:02.188099 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:01:02.188335 26013 external_mini_cluster.cc:1428] Setting key fc13587f632677f28017464390ebeffe
I20260812 00:01:02.188388 9090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:02.191926 9093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:02.189270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51264 (local address 127.25.103.126:33995)
0812 00:01:02.189491 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:02.189500 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:02.189531 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:01:02.190278 (+ 747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:02.190288 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:02.190339 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:02.190514 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:02.191347 (+ 833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:02.191351 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:02.191351 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:01:02.191355 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:02.191428 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:01:02.191439 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:02.191503 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:02.191663 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 00:01:02.191737 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":77,"threads_started":1}
I20260812 00:01:02.192529 9090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714: Bootstrap starting.
I20260812 00:01:02.193262 9090 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:02.193560 9090 log.cc:824] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:02.194907 9090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714: No bootstrap required, opened a new log
I20260812 00:01:02.196841 9090 raft_consensus.cc:348] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "021e902013aa44058e3ab9e4dfc84714" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 33995 } }
I20260812 00:01:02.197062 9090 raft_consensus.cc:374] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:02.197089 9090 raft_consensus.cc:729] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021e902013aa44058e3ab9e4dfc84714, State: Initialized, Role: FOLLOWER
I20260812 00:01:02.197269 9090 consensus_queue.cc:260] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "021e902013aa44058e3ab9e4dfc84714" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 33995 } }
I20260812 00:01:02.197359 9090 raft_consensus.cc:388] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:01:02.197393 9090 raft_consensus.cc:482] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:01:02.197450 9090 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:02.198444 9090 raft_consensus.cc:504] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "021e902013aa44058e3ab9e4dfc84714" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 33995 } }
I20260812 00:01:02.198576 9090 leader_election.cc:302] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 021e902013aa44058e3ab9e4dfc84714; no voters:
I20260812 00:01:02.198810 9090 leader_election.cc:288] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:01:02.199208 9097 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:02.199210 9090 sys_catalog.cc:564] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:01:02.199483 9097 raft_consensus.cc:686] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714 [term 1 LEADER]: Becoming Leader. State: Replica: 021e902013aa44058e3ab9e4dfc84714, State: Running, Role: LEADER
I20260812 00:01:02.199649 9097 consensus_queue.cc:237] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "021e902013aa44058e3ab9e4dfc84714" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 33995 } }
I20260812 00:01:02.200237 9099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 021e902013aa44058e3ab9e4dfc84714. Latest consensus state: current_term: 1 leader_uuid: "021e902013aa44058e3ab9e4dfc84714" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "021e902013aa44058e3ab9e4dfc84714" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 33995 } } }
I20260812 00:01:02.200369 9099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714 [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:02.200666 9108 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:01:02.200919 9098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "021e902013aa44058e3ab9e4dfc84714" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "021e902013aa44058e3ab9e4dfc84714" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 33995 } } }
I20260812 00:01:02.201032 9098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714 [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:02.201327 9108 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:01:02.203778 9108 catalog_manager.cc:1347] Generated new cluster ID: ca37f2beb004454fa7d5e8308c47e0ba
I20260812 00:01:02.203845 9108 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:01:02.223695 9108 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:01:02.223901 9108 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:01:02.228650 9108 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 021e902013aa44058e3ab9e4dfc84714: Generated new TSK 0
I20260812 00:01:02.228995 9108 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:01:02.234171 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:33995
--builtin_ntp_servers=127.25.103.84:44719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 00:01:02.349992 9126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:02.350270 9126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:02.350301 9126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:02.352711 9126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:02.352811 9126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:02.352855 9126 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:01:02.354848 9126 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:44719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:33995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9126
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:01:02.355201 9126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:02.355571 9126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:02.361888 9138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:02.361794 9134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:02.361918 9131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:02.363108 9126 server_base.cc:1034] running on GCE node
I20260812 00:01:02.363729 9126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:02.364101 9126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:02.365374 9126 hybrid_clock.cc:648] HybridClock initialized: now 1786492862365296 us; error 47 us; skew 500 ppm
I20260812 00:01:02.367185 9126 webserver.cc:460] Webserver started at http://127.25.103.65:43577/ using document root <none> and password file <none>
I20260812 00:01:02.367520 9126 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:02.367581 9126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:02.367728 9126 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:02.369254 9126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "0cf6838344924928a48815e7990abc5d"
format_stamp: "Formatted at 2026-08-12 00:01:02 on dist-test-slave-vpvm"
server_key: "be7fd9d7b1c1dfe84d0f63856d62627e"
server_key_iv: "ab030c65d5336b0f43c1607a27872d13"
server_key_version: "encryptionkey@0"
I20260812 00:01:02.369745 9126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "0cf6838344924928a48815e7990abc5d"
format_stamp: "Formatted at 2026-08-12 00:01:02 on dist-test-slave-vpvm"
server_key: "be7fd9d7b1c1dfe84d0f63856d62627e"
server_key_iv: "ab030c65d5336b0f43c1607a27872d13"
server_key_version: "encryptionkey@0"
I20260812 00:01:02.371429 9126 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260812 00:01:02.372375 9145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:02.372555 9126 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:02.372687 9126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "0cf6838344924928a48815e7990abc5d"
format_stamp: "Formatted at 2026-08-12 00:01:02 on dist-test-slave-vpvm"
server_key: "be7fd9d7b1c1dfe84d0f63856d62627e"
server_key_iv: "ab030c65d5336b0f43c1607a27872d13"
server_key_version: "encryptionkey@0"
I20260812 00:01:02.372776 9126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:02.376452 9126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:02.376758 9126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:02.376888 9126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:02.377089 9126 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:02.377405 9126 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:02.377439 9126 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:02.377470 9126 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:02.377493 9126 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:02.384333 9126 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:42865
I20260812 00:01:02.384451 9324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:42865 every 8 connection(s)
I20260812 00:01:02.384802 9126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:01:02.389431 9093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:02.385884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:55903 (local address 127.25.103.126:33995)
0812 00:01:02.386035 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:02.386038 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:02.386300 (+ 262us) server_negotiation.cc:407] Connection header received
0812 00:01:02.387103 (+ 803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:02.387105 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:02.387114 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:02.387148 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:02.389125 (+ 1977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:02.389127 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:02.389127 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:01:02.389133 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:02.389162 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:01:02.389167 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:02.389225 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:02.389312 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 00:01:02.389331 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260812 00:01:02.389668 9329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:02.385800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:33995 (local address 127.25.103.65:55903)
0812 00:01:02.386108 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:02.386159 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:02.386949 (+ 790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:02.387383 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:02.387388 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:02.387401 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:02.388928 (+ 1527us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:01:02.388929 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:02.388982 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:01:02.389028 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:02.389224 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:02.389231 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:02.389235 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:01:02.389324 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 00:01:02.389405 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":177,"threads_started":1}
I20260812 00:01:02.390348 9325 heartbeater.cc:347] Connected to a master server at 127.25.103.126:33995
I20260812 00:01:02.390470 9325 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:02.390677 9325 heartbeater.cc:511] Master 127.25.103.126:33995 requested a full tablet report, sending...
I20260812 00:01:02.391584 9035 ts_manager.cc:194] Registered new tserver with Master: 0cf6838344924928a48815e7990abc5d (127.25.103.65:42865)
I20260812 00:01:02.393364 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 9126
I20260812 00:01:02.393481 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:01:02.393814 26013 external_mini_cluster.cc:1428] Setting key 9455f3fd9bebf5c2672549af47484854
I20260812 00:01:02.395169 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:33995
--builtin_ntp_servers=127.25.103.84:44719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 00:01:02.492507 9331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:02.492784 9331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:02.492815 9331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:02.494324 9331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:02.494383 9331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:02.494418 9331 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:01:02.497093 9331 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:44719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:33995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9331
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:01:02.497450 9331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:02.497824 9331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:02.503733 9341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:02.503748 9336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:02.503760 9339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:02.504151 9331 server_base.cc:1034] running on GCE node
I20260812 00:01:02.504437 9331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:02.504833 9331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:02.506076 9331 hybrid_clock.cc:648] HybridClock initialized: now 1786492862506042 us; error 52 us; skew 500 ppm
I20260812 00:01:02.507977 9331 webserver.cc:460] Webserver started at http://127.25.103.66:36871/ using document root <none> and password file <none>
I20260812 00:01:02.508296 9331 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:02.508353 9331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:02.508500 9331 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:02.509696 9331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "b8b37f12d8f241b5b570389201ab05a9"
format_stamp: "Formatted at 2026-08-12 00:01:02 on dist-test-slave-vpvm"
server_key: "3d1800468971acf61a97790a95b8e17e"
server_key_iv: "09ceaf00a0b4f6906628df88036f74bc"
server_key_version: "encryptionkey@0"
I20260812 00:01:02.510149 9331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "b8b37f12d8f241b5b570389201ab05a9"
format_stamp: "Formatted at 2026-08-12 00:01:02 on dist-test-slave-vpvm"
server_key: "3d1800468971acf61a97790a95b8e17e"
server_key_iv: "09ceaf00a0b4f6906628df88036f74bc"
server_key_version: "encryptionkey@0"
I20260812 00:01:02.511940 9331 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260812 00:01:02.512971 9348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:02.513366 9331 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:01:02.513600 9331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "b8b37f12d8f241b5b570389201ab05a9"
format_stamp: "Formatted at 2026-08-12 00:01:02 on dist-test-slave-vpvm"
server_key: "3d1800468971acf61a97790a95b8e17e"
server_key_iv: "09ceaf00a0b4f6906628df88036f74bc"
server_key_version: "encryptionkey@0"
I20260812 00:01:02.513700 9331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:02.517526 9331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:02.517859 9331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:02.518038 9331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:02.518260 9331 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:02.518712 9331 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:02.518772 9331 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:02.518807 9331 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:02.518823 9331 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:02.526846 9331 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:44503
I20260812 00:01:02.526917 9523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:44503 every 8 connection(s)
I20260812 00:01:02.527333 9331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:01:02.531324 9093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:02.528380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:54677 (local address 127.25.103.126:33995)
0812 00:01:02.528454 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:02.528456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:02.528726 (+ 270us) server_negotiation.cc:407] Connection header received
0812 00:01:02.529292 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:02.529293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:02.529301 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:02.529356 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:02.530717 (+ 1361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:02.530719 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:02.530719 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:01:02.530725 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:02.530743 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:01:02.530748 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:02.531028 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:02.531197 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 00:01:02.531223 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 00:01:02.531560 9526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:02.528239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:33995 (local address 127.25.103.66:54677)
0812 00:01:02.528555 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:02.528611 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:02.529181 (+ 570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:02.529446 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:02.529451 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:02.529460 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:02.530530 (+ 1070us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:01:02.530530 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:02.530566 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:01:02.530604 (+ 38us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:02.531030 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:02.531042 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:02.531047 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:01:02.531198 (+ 151us) client_negotiation.cc:240] Negotiation successful
0812 00:01:02.531293 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":93,"threads_started":1}
I20260812 00:01:02.532248 9524 heartbeater.cc:347] Connected to a master server at 127.25.103.126:33995
I20260812 00:01:02.532383 9524 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:02.532570 9524 heartbeater.cc:511] Master 127.25.103.126:33995 requested a full tablet report, sending...
I20260812 00:01:02.532783 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 9331
I20260812 00:01:02.532874 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:01:02.533080 26013 external_mini_cluster.cc:1428] Setting key 17322a6ca35b86dc30bd5320bf92cb54
I20260812 00:01:02.533066 9035 ts_manager.cc:194] Registered new tserver with Master: b8b37f12d8f241b5b570389201ab05a9 (127.25.103.66:44503)
I20260812 00:01:02.534235 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:33995
--builtin_ntp_servers=127.25.103.84:44719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 00:01:02.634096 9527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:02.634349 9527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:02.634379 9527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:02.635933 9527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:02.636015 9527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:02.636049 9527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:01:02.637862 9527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:44719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:33995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:01:02.638211 9527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:02.638564 9527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:02.644865 9536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:02.644842 9538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:02.644867 9535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:02.644893 9527 server_base.cc:1034] running on GCE node
I20260812 00:01:02.645409 9527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:02.645691 9527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:02.646886 9527 hybrid_clock.cc:648] HybridClock initialized: now 1786492862646866 us; error 40 us; skew 500 ppm
I20260812 00:01:02.648739 9527 webserver.cc:460] Webserver started at http://127.25.103.67:45927/ using document root <none> and password file <none>
I20260812 00:01:02.649061 9527 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:02.649120 9527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:02.649274 9527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:02.650631 9527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "e5605a62f60e4fb18b1311bd9179ca7b"
format_stamp: "Formatted at 2026-08-12 00:01:02 on dist-test-slave-vpvm"
server_key: "c2e3db726ca407698a390acc8ed0ace4"
server_key_iv: "305776468c348789da5fccf50edccb84"
server_key_version: "encryptionkey@0"
I20260812 00:01:02.651046 9527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "e5605a62f60e4fb18b1311bd9179ca7b"
format_stamp: "Formatted at 2026-08-12 00:01:02 on dist-test-slave-vpvm"
server_key: "c2e3db726ca407698a390acc8ed0ace4"
server_key_iv: "305776468c348789da5fccf50edccb84"
server_key_version: "encryptionkey@0"
I20260812 00:01:02.652735 9527 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:01:02.653924 9557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:02.654232 9527 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:02.654353 9527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "e5605a62f60e4fb18b1311bd9179ca7b"
format_stamp: "Formatted at 2026-08-12 00:01:02 on dist-test-slave-vpvm"
server_key: "c2e3db726ca407698a390acc8ed0ace4"
server_key_iv: "305776468c348789da5fccf50edccb84"
server_key_version: "encryptionkey@0"
I20260812 00:01:02.654450 9527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:02.658291 9527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:02.658630 9527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:02.658775 9527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:02.659013 9527 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:02.659380 9527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:02.659420 9527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:02.659451 9527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:02.659600 9527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:02.667225 9527 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:36907
I20260812 00:01:02.667275 9765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:36907 every 8 connection(s)
I20260812 00:01:02.667712 9527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:01:02.671180 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 9527
I20260812 00:01:02.671283 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:01:02.671476 26013 external_mini_cluster.cc:1428] Setting key e8c9f158468e2d43a01320e6a4fa86ce
I20260812 00:01:02.671509 9093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:02.668772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:51615 (local address 127.25.103.126:33995)
0812 00:01:02.668875 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:02.668878 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:02.669160 (+ 282us) server_negotiation.cc:407] Connection header received
0812 00:01:02.669662 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:02.669663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:02.669679 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:02.669751 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:02.671200 (+ 1449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:02.671201 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:02.671202 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:01:02.671206 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:02.671223 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:01:02.671228 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:02.671281 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:02.671390 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 00:01:02.671426 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 00:01:02.671958 9768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:02.668593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:33995 (local address 127.25.103.67:51615)
0812 00:01:02.668900 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:02.668956 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:02.669535 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:02.669878 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:02.669882 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:02.669894 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:02.670975 (+ 1081us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:01:02.670976 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:02.671013 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:01:02.671050 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:02.671290 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:02.671296 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:02.671299 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:01:02.671635 (+ 336us) client_negotiation.cc:240] Negotiation successful
0812 00:01:02.671720 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":88,"threads_started":1}
I20260812 00:01:02.672665 9766 heartbeater.cc:347] Connected to a master server at 127.25.103.126:33995
I20260812 00:01:02.672770 9766 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:02.672907 9766 heartbeater.cc:511] Master 127.25.103.126:33995 requested a full tablet report, sending...
I20260812 00:01:02.673363 9035 ts_manager.cc:194] Registered new tserver with Master: e5605a62f60e4fb18b1311bd9179ca7b (127.25.103.67:36907)
I20260812 00:01:02.684105 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 00:01:02.686919 9093 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:01:02.686261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51272 (local address 127.25.103.126:33995)
0812 00:01:02.686358 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:02.686361 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:02.686486 (+ 125us) server_negotiation.cc:407] Connection header received
0812 00:01:02.686587 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:02.686589 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:02.686597 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:02.686650 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:02.686832 (+ 182us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51272: BlockingRecv error: recv got EOF from 127.0.0.1:51272 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 00:01:02.687119 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 9126
I20260812 00:01:02.713708 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 9331
I20260812 00:01:02.741401 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 9527
I20260812 00:01:02.764227 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 8987
2026-08-12T00:01:02Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (746 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:01:02 dist-test-slave-vpvm krb5kdc[9783](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:01:02 dist-test-slave-vpvm krb5kdc[9783](info): set up 2 sockets
Aug 12 00:01:02 dist-test-slave-vpvm krb5kdc[9783](info): commencing operation
krb5kdc: starting...
W20260812 00:01:04.003991 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:01:04 dist-test-slave-vpvm krb5kdc[9783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:01:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:01:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:01:04.153741 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:42039
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:45247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:42039
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:04.244841 9803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:04.245110 9803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:04.245146 9803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:04.246515 9803 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:01:04.246588 9803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:04.246608 9803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:04.246628 9803 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:01:04.246644 9803 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:01:04.248431 9803 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:45247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:42039
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:42039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:01:04.248788 9803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:04.249075 9803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:04.255630 9813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:04.255666 9811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:04.255873 9810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:04.256176 9803 server_base.cc:1034] running on GCE node
I20260812 00:01:04.256448 9803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:04.256753 9803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:04.257931 9803 hybrid_clock.cc:648] HybridClock initialized: now 1786492864257911 us; error 34 us; skew 500 ppm
Aug 12 00:01:04 dist-test-slave-vpvm krb5kdc[9783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492864, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:04.261638 9803 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:01:04.262270 9803 webserver.cc:460] Webserver started at http://127.25.103.126:41045/ using document root <none> and password file <none>
I20260812 00:01:04.262516 9803 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:04.262584 9803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:04.262737 9803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:04.263967 9803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "826f985f78cc458ca03750a6d05a2b83"
format_stamp: "Formatted at 2026-08-12 00:01:04 on dist-test-slave-vpvm"
server_key: "983ac93652c1ce7a2d42f648ef00992e"
server_key_iv: "931d6b4518c0e505baa600964b4c9d85"
server_key_version: "encryptionkey@0"
I20260812 00:01:04.264354 9803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "826f985f78cc458ca03750a6d05a2b83"
format_stamp: "Formatted at 2026-08-12 00:01:04 on dist-test-slave-vpvm"
server_key: "983ac93652c1ce7a2d42f648ef00992e"
server_key_iv: "931d6b4518c0e505baa600964b4c9d85"
server_key_version: "encryptionkey@0"
I20260812 00:01:04.265903 9803 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:01:04.267357 9826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:04.267637 9803 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:04.267812 9803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "826f985f78cc458ca03750a6d05a2b83"
format_stamp: "Formatted at 2026-08-12 00:01:04 on dist-test-slave-vpvm"
server_key: "983ac93652c1ce7a2d42f648ef00992e"
server_key_iv: "931d6b4518c0e505baa600964b4c9d85"
server_key_version: "encryptionkey@0"
I20260812 00:01:04.267917 9803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:04.283190 9803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:04.286448 9803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:04.286641 9803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:04.291836 9803 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:42039
I20260812 00:01:04.291887 9913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:42039 every 8 connection(s)
I20260812 00:01:04.292445 9803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:01:04.293762 9914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:04.296481 9914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83: Bootstrap starting.
I20260812 00:01:04.297115 9914 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:04.297361 9914 log.cc:824] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:04.298270 9914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83: No bootstrap required, opened a new log
I20260812 00:01:04.299948 9914 raft_consensus.cc:348] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "826f985f78cc458ca03750a6d05a2b83" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42039 } }
I20260812 00:01:04.300134 9914 raft_consensus.cc:374] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:04.300158 9914 raft_consensus.cc:729] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 826f985f78cc458ca03750a6d05a2b83, State: Initialized, Role: FOLLOWER
I20260812 00:01:04.300278 9914 consensus_queue.cc:260] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "826f985f78cc458ca03750a6d05a2b83" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42039 } }
I20260812 00:01:04.300341 9914 raft_consensus.cc:388] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:01:04.300371 9914 raft_consensus.cc:482] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:01:04.300417 9914 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:04.301342 9914 raft_consensus.cc:504] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "826f985f78cc458ca03750a6d05a2b83" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42039 } }
I20260812 00:01:04.301369 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 9803
I20260812 00:01:04.301532 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:01:04.301704 26013 external_mini_cluster.cc:1428] Setting key b210e31c78ebe4500768dc62c52ab304
I20260812 00:01:04.301644 9914 leader_election.cc:302] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 826f985f78cc458ca03750a6d05a2b83; no voters:
I20260812 00:01:04.301980 9914 leader_election.cc:288] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:01:04.302034 9924 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:04.302178 9924 raft_consensus.cc:686] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83 [term 1 LEADER]: Becoming Leader. State: Replica: 826f985f78cc458ca03750a6d05a2b83, State: Running, Role: LEADER
I20260812 00:01:04.302291 9924 consensus_queue.cc:237] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "826f985f78cc458ca03750a6d05a2b83" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42039 } }
I20260812 00:01:04.302400 9914 sys_catalog.cc:564] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:01:04.302753 9924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "826f985f78cc458ca03750a6d05a2b83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "826f985f78cc458ca03750a6d05a2b83" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42039 } } }
I20260812 00:01:04.302837 9924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83 [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:04.302992 9924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 826f985f78cc458ca03750a6d05a2b83. Latest consensus state: current_term: 1 leader_uuid: "826f985f78cc458ca03750a6d05a2b83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "826f985f78cc458ca03750a6d05a2b83" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42039 } } }
I20260812 00:01:04.303068 9924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83 [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:04.303421 9933 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:01:04.304296 9933 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:01:04.306560 9933 catalog_manager.cc:1347] Generated new cluster ID: e4a86636e3f540f292eb82ee2b086f59
I20260812 00:01:04.306636 9933 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:01:04 dist-test-slave-vpvm krb5kdc[9783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:01:04.313673 9933 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:01:04.315461 9933 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:01:04.317382 9931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:04.302414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55742 (local address 127.25.103.126:42039)
0812 00:01:04.302772 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:04.302784 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:04.302831 (+ 47us) server_negotiation.cc:407] Connection header received
0812 00:01:04.302999 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:04.303008 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:04.303077 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:04.304227 (+ 1150us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:04.304352 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.305745 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.307060 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.307739 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.307867 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:04.311519 (+ 3652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:04.311528 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:04.311528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:04.311552 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:04.314839 (+ 3287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:04.315489 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:04.315493 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:04.315494 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:04.315648 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:04.315926 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:04.315927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:04.315927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:04.316419 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:04.316630 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:04.316787 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 00:01:04.317007 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":209,"threads_started":1}
I20260812 00:01:04.327876 9933 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83: Generated new TSK 0
I20260812 00:01:04.328135 9933 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
I20260812 00:01:04.361891 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42039
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:45247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:04.460219 9958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:04.460659 9958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:04.460807 9958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:04.463044 9958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:04.463133 9958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:04.463169 9958 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:01:04.465152 9958 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:45247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:01:04.465459 9958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:04.465756 9958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:04.471854 9966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:04.471836 9967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:04.471964 9969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:04.471868 9958 server_base.cc:1034] running on GCE node
I20260812 00:01:04.472438 9958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:04.472775 9958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:04.474026 9958 hybrid_clock.cc:648] HybridClock initialized: now 1786492864473979 us; error 66 us; skew 500 ppm
Aug 12 00:01:04 dist-test-slave-vpvm krb5kdc[9783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492864, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:04.477301 9958 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:01:04.477988 9958 webserver.cc:460] Webserver started at http://127.25.103.65:37849/ using document root <none> and password file <none>
I20260812 00:01:04.478329 9958 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:04.478389 9958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:04.478545 9958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:04.479871 9958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "ef5c5261690a4a93a42720d6e116d6f9"
format_stamp: "Formatted at 2026-08-12 00:01:04 on dist-test-slave-vpvm"
server_key: "98a451c5a499bcdd8433db0e8cdfb13e"
server_key_iv: "dd6eddc9d02b4392e0b002475c3efd76"
server_key_version: "encryptionkey@0"
I20260812 00:01:04.480388 9958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "ef5c5261690a4a93a42720d6e116d6f9"
format_stamp: "Formatted at 2026-08-12 00:01:04 on dist-test-slave-vpvm"
server_key: "98a451c5a499bcdd8433db0e8cdfb13e"
server_key_iv: "dd6eddc9d02b4392e0b002475c3efd76"
server_key_version: "encryptionkey@0"
I20260812 00:01:04.482223 9958 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 00:01:04.483801 9979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:04.484123 9958 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:01:04.484264 9958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "ef5c5261690a4a93a42720d6e116d6f9"
format_stamp: "Formatted at 2026-08-12 00:01:04 on dist-test-slave-vpvm"
server_key: "98a451c5a499bcdd8433db0e8cdfb13e"
server_key_iv: "dd6eddc9d02b4392e0b002475c3efd76"
server_key_version: "encryptionkey@0"
I20260812 00:01:04.484364 9958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:04.502416 9958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:04.505299 9958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:04.505499 9958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:04.505760 9958 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:04.506112 9958 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:04.506150 9958 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:04.506181 9958 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:04.506199 9958 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:04.512729 9958 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:33659
I20260812 00:01:04.512823 10157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:33659 every 8 connection(s)
I20260812 00:01:04.513195 9958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:01:04.519348 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 9958
I20260812 00:01:04.519467 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:01:04.519822 26013 external_mini_cluster.cc:1428] Setting key b28e7bef8eb396f7ae19f124a6f59b14
Aug 12 00:01:04 dist-test-slave-vpvm krb5kdc[9783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492864, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:01:04.525758 9931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:04.514309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:49769 (local address 127.25.103.126:42039)
0812 00:01:04.514366 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:04.514372 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:04.514682 (+ 310us) server_negotiation.cc:407] Connection header received
0812 00:01:04.515325 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:04.515328 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:04.515344 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:04.515524 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:04.516774 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.517328 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.519642 (+ 2314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.519884 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.519973 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:04.522793 (+ 2820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:04.522795 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:04.522796 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:04.522804 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:04.524287 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:04.524753 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:04.524754 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:04.524754 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:04.524813 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:04.525064 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:04.525065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:04.525065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:04.525196 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:04.525258 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:04.525552 (+ 294us) server_negotiation.cc:299] Negotiation successful
0812 00:01:04.525658 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:01:04.525982 10160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:04.514252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42039 (local address 127.25.103.65:49769)
0812 00:01:04.514482 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:04.514531 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:04.515168 (+ 637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:04.515600 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:04.515604 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:04.516341 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:04.516628 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:04.516634 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.517487 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.517488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:04.518925 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:04.518935 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.520018 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.520020 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:04.520193 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:04.520883 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:04.520893 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:04.522672 (+ 1779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:04.524405 (+ 1733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:04.524415 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:04.524419 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:04.524676 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:04.524876 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:04.524877 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:04.524877 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:04.525003 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:04.525256 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:04.525263 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:04.525415 (+ 152us) client_negotiation.cc:769] Sending connection context
0812 00:01:04.525516 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 00:01:04.525707 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":134,"threads_started":1}
I20260812 00:01:04.526562 10158 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42039
I20260812 00:01:04.526671 10158 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:04.526867 10158 heartbeater.cc:511] Master 127.25.103.126:42039 requested a full tablet report, sending...
I20260812 00:01:04.527534 9858 ts_manager.cc:194] Registered new tserver with Master: ef5c5261690a4a93a42720d6e116d6f9 (127.25.103.65:33659)
I20260812 00:01:04.528465 9858 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:49769
WARNING: no policy specified for kudu/127.25.103.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
I20260812 00:01:04.551064 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42039
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:45247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:04.642478 10165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:04.642732 10165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:04.642768 10165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:04.644027 10165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:04.644081 10165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:04.644119 10165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:01:04.645707 10165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:45247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:01:04.646000 10165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:04.646523 10165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:01:04.653306 10165 server_base.cc:1034] running on GCE node
W20260812 00:01:04.653278 10176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:04.653281 10179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:04.653249 10175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:04.653770 10165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:04.654110 10165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:04.655289 10165 hybrid_clock.cc:648] HybridClock initialized: now 1786492864655272 us; error 31 us; skew 500 ppm
Aug 12 00:01:04 dist-test-slave-vpvm krb5kdc[9783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492864, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:04.658244 10165 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:01:04.658776 10165 webserver.cc:460] Webserver started at http://127.25.103.66:38133/ using document root <none> and password file <none>
I20260812 00:01:04.659010 10165 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:04.659058 10165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:04.659190 10165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:04.660439 10165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "166f838e6fd44c9f9c626d2690a9dfa3"
format_stamp: "Formatted at 2026-08-12 00:01:04 on dist-test-slave-vpvm"
server_key: "e736e4c7c78c8a68c6391cd3ad1d44e0"
server_key_iv: "d33ffd9af8c0360dccd0a36407cb8973"
server_key_version: "encryptionkey@0"
I20260812 00:01:04.660854 10165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "166f838e6fd44c9f9c626d2690a9dfa3"
format_stamp: "Formatted at 2026-08-12 00:01:04 on dist-test-slave-vpvm"
server_key: "e736e4c7c78c8a68c6391cd3ad1d44e0"
server_key_iv: "d33ffd9af8c0360dccd0a36407cb8973"
server_key_version: "encryptionkey@0"
I20260812 00:01:04.662477 10165 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:01:04.663789 10189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:04.664162 10165 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:01:04.664301 10165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "166f838e6fd44c9f9c626d2690a9dfa3"
format_stamp: "Formatted at 2026-08-12 00:01:04 on dist-test-slave-vpvm"
server_key: "e736e4c7c78c8a68c6391cd3ad1d44e0"
server_key_iv: "d33ffd9af8c0360dccd0a36407cb8973"
server_key_version: "encryptionkey@0"
I20260812 00:01:04.664505 10165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:04.679005 10165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:04.682089 10165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:04.682307 10165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:04.682619 10165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:04.683043 10165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:04.683084 10165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:04.683132 10165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:04.683158 10165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:04.690896 10165 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:37585
I20260812 00:01:04.691005 10371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:37585 every 8 connection(s)
I20260812 00:01:04.691339 10165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:01:04 dist-test-slave-vpvm krb5kdc[9783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492864, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:01:04.698839 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 10165
I20260812 00:01:04.698940 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:01:04.699134 26013 external_mini_cluster.cc:1428] Setting key cd1cceededa6a042ec1336f987376eca
I20260812 00:01:04.702598 9931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:04.692278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:41499 (local address 127.25.103.126:42039)
0812 00:01:04.692342 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:04.692345 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:04.692527 (+ 182us) server_negotiation.cc:407] Connection header received
0812 00:01:04.693137 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:04.693140 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:04.693190 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:04.693293 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:04.694485 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.695011 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.696116 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.696374 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.696464 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:04.699416 (+ 2952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:04.699418 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:04.699418 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:04.699427 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:04.700875 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:04.701438 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:04.701439 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:04.701439 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:04.701508 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:04.701822 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:04.701822 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:04.701823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:04.702016 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:04.702086 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:04.702399 (+ 313us) server_negotiation.cc:299] Negotiation successful
0812 00:01:04.702502 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:01:04.702817 10378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:04.692229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42039 (local address 127.25.103.66:41499)
0812 00:01:04.692395 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:04.692440 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:04.692966 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:04.693369 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:04.693373 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:04.694074 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:04.694311 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:04.694317 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.695122 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.695123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:04.695979 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:04.695981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.696540 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.696542 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:04.696741 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:04.697492 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:04.697502 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:04.699279 (+ 1777us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:04.700975 (+ 1696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:04.700986 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:04.700989 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:04.701332 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:04.701597 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:04.701598 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:04.701598 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:04.701761 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:04.702084 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:04.702092 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:04.702267 (+ 175us) client_negotiation.cc:769] Sending connection context
0812 00:01:04.702380 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 00:01:04.702571 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":89,"threads_started":1}
I20260812 00:01:04.703471 10373 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42039
I20260812 00:01:04.703575 10373 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:04.703773 10373 heartbeater.cc:511] Master 127.25.103.126:42039 requested a full tablet report, sending...
I20260812 00:01:04.704202 9858 ts_manager.cc:194] Registered new tserver with Master: 166f838e6fd44c9f9c626d2690a9dfa3 (127.25.103.66:37585)
I20260812 00:01:04.704617 9858 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:41499
WARNING: no policy specified for kudu/127.25.103.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
I20260812 00:01:04.730436 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42039
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:45247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:04.824731 10382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:04.824997 10382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:04.825039 10382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:04.826397 10382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:04.826449 10382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:04.826491 10382 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:01:04.828105 10382 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:45247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:01:04.828578 10382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:04.828905 10382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:04.834699 10392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:04.834787 10390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:04.834692 10394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:04.835141 10382 server_base.cc:1034] running on GCE node
I20260812 00:01:04.835494 10382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:04.835903 10382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:04.837095 10382 hybrid_clock.cc:648] HybridClock initialized: now 1786492864837040 us; error 72 us; skew 500 ppm
Aug 12 00:01:04 dist-test-slave-vpvm krb5kdc[9783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492864, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:04.840458 10382 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:01:04.841055 10382 webserver.cc:460] Webserver started at http://127.25.103.67:37155/ using document root <none> and password file <none>
I20260812 00:01:04.841336 10382 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:04.841399 10382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:04.841547 10382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:04.842828 10382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "adc4835a487f4cc1ac113997991ef7f9"
format_stamp: "Formatted at 2026-08-12 00:01:04 on dist-test-slave-vpvm"
server_key: "e45115987fb1c9c2c0a2c1aba3733e1e"
server_key_iv: "d3fa49efcb17c9cf5db97464a756cc6f"
server_key_version: "encryptionkey@0"
I20260812 00:01:04.843266 10382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "adc4835a487f4cc1ac113997991ef7f9"
format_stamp: "Formatted at 2026-08-12 00:01:04 on dist-test-slave-vpvm"
server_key: "e45115987fb1c9c2c0a2c1aba3733e1e"
server_key_iv: "d3fa49efcb17c9cf5db97464a756cc6f"
server_key_version: "encryptionkey@0"
I20260812 00:01:04.844952 10382 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:01:04.846057 10405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:04.846318 10382 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:04.846531 10382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "adc4835a487f4cc1ac113997991ef7f9"
format_stamp: "Formatted at 2026-08-12 00:01:04 on dist-test-slave-vpvm"
server_key: "e45115987fb1c9c2c0a2c1aba3733e1e"
server_key_iv: "d3fa49efcb17c9cf5db97464a756cc6f"
server_key_version: "encryptionkey@0"
I20260812 00:01:04.846658 10382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:04.860190 10382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:04.862603 10382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:04.862780 10382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:04.863067 10382 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:04.863483 10382 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:04.863610 10382 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:04.863691 10382 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:04.863716 10382 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:04.869935 10382 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:38611
I20260812 00:01:04.870020 10587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:38611 every 8 connection(s)
I20260812 00:01:04.870373 10382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:01:04 dist-test-slave-vpvm krb5kdc[9783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492864, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:01:04.878197 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 10382
I20260812 00:01:04.878304 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:01:04.878489 26013 external_mini_cluster.cc:1428] Setting key ce7b3fb2559be3e8ea88eb8189591434
I20260812 00:01:04.881665 10592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:04.871125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42039 (local address 127.25.103.67:60217)
0812 00:01:04.871336 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:04.871374 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:04.871916 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:04.872194 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:04.872197 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:04.872851 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:04.873079 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:04.873084 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.874130 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.874131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:04.875013 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:04.875016 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.875642 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.875644 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:04.875777 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:04.876371 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:04.876444 (+ 73us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:04.878253 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:04.880170 (+ 1917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:04.880178 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:04.880180 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:04.880443 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:04.880686 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:04.880686 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:04.880687 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:04.880798 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:04.881101 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:04.881105 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:04.881240 (+ 135us) client_negotiation.cc:769] Sending connection context
0812 00:01:04.881323 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 00:01:04.881463 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":83,"threads_started":1}
I20260812 00:01:04.881672 9931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:04.871205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:60217 (local address 127.25.103.126:42039)
0812 00:01:04.871263 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:04.871266 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:04.871500 (+ 234us) server_negotiation.cc:407] Connection header received
0812 00:01:04.872045 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:04.872046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:04.872060 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:04.872128 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:04.873183 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.873886 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.875267 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.875497 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.875585 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:04.878410 (+ 2825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:04.878413 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:04.878413 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:04.878423 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:04.880090 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:04.880543 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:04.880544 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:04.880545 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:04.880615 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:04.880904 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:04.880905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:04.880905 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:04.881043 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:04.881107 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:04.881446 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 00:01:04.881582 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:01:04.882289 10588 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42039
I20260812 00:01:04.882395 10588 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:04.882588 10588 heartbeater.cc:511] Master 127.25.103.126:42039 requested a full tablet report, sending...
I20260812 00:01:04.883033 9858 ts_manager.cc:194] Registered new tserver with Master: adc4835a487f4cc1ac113997991ef7f9 (127.25.103.67:38611)
I20260812 00:01:04.883427 9858 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:60217
I20260812 00:01:04.891273 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:01:04.899588 9931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:04.893124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55752 (local address 127.25.103.126:42039)
0812 00:01:04.893229 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:04.893231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:04.893245 (+ 14us) server_negotiation.cc:407] Connection header received
0812 00:01:04.893334 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:04.893335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:04.893347 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:04.893401 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:04.894030 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.894543 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.895265 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.895464 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.895521 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:04.896788 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:04.896790 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:04.896790 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:04.896798 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:04.898489 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:04.898812 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:04.898813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:04.898814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:04.898867 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:04.899029 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:04.899030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:04.899030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:04.899193 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:04.899284 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:04.899400 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 00:01:04.899491 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:01:04.901894 9858 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55752:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:01:04.903903 9858 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:01:04.912827 10615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:04.907984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52668 (local address 127.25.103.65:33659)
0812 00:01:04.908252 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:04.908256 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:04.908496 (+ 240us) server_negotiation.cc:407] Connection header received
0812 00:01:04.908637 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:04.908640 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:04.908660 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:04.908724 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:04.909005 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.910243 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.911399 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.912193 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.912281 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:04.912350 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:04.912659 (+ 309us) server_negotiation.cc:299] Negotiation successful
0812 00:01:04.912711 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":120,"threads_started":1}
I20260812 00:01:04.912873 10607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:04.907622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:33659 (local address 127.0.0.1:52668)
0812 00:01:04.908411 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:04.908421 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:04.908531 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:04.908834 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:04.908835 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:04.908838 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:04.908908 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:04.908911 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.910343 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.910344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:04.911330 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:04.911333 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.912349 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.912352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:04.912484 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:04.912516 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 00:01:04.912628 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 00:01:04.912738 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":768,"mutex_wait_us":57,"thread_start_us":153,"threads_started":1}
I20260812 00:01:04.912873 10606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:04.907572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:38611 (local address 127.0.0.1:47108)
0812 00:01:04.907752 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:04.907799 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:04.907885 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:04.908343 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:04.908347 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:04.908350 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:04.908488 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:04.908491 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.910132 (+ 1641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.910133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:04.911390 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:04.911394 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.912351 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.912353 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:04.912503 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:04.912516 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 00:01:04.912628 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 00:01:04.912735 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":2,"thread_start_us":117,"threads_started":1}
I20260812 00:01:04.913636 10609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:04.907622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:37585 (local address 127.0.0.1:40982)
0812 00:01:04.908223 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:04.908237 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:04.908304 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:04.908545 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:04.908547 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:04.908550 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:04.908634 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:04.908637 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.909753 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.909755 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:04.911405 (+ 1650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:04.911408 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.913351 (+ 1943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.913353 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:04.913434 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:04.913439 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:01:04.913484 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 00:01:04.913548 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"mutex_wait_us":6,"thread_start_us":157,"threads_started":1}
I20260812 00:01:04.913893 10611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:04.907984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40982 (local address 127.25.103.66:37585)
0812 00:01:04.908380 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:04.908384 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:04.908395 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:01:04.908432 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:04.908433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:04.908446 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:04.908523 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:04.908705 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.909639 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.912409 (+ 2770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.913179 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.913248 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:04.913307 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:04.913749 (+ 442us) server_negotiation.cc:299] Negotiation successful
0812 00:01:04.913809 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":126,"threads_started":1}
I20260812 00:01:04.913321 10610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:04.907834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47108 (local address 127.25.103.67:38611)
0812 00:01:04.908087 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:04.908092 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:04.908102 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:01:04.908167 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:04.908169 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:04.908189 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:04.908283 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:04.908625 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.909989 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.911509 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:04.912210 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:04.912281 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:04.912350 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:04.913163 (+ 813us) server_negotiation.cc:299] Negotiation successful
0812 00:01:04.913220 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":137,"threads_started":1}
I20260812 00:01:04.914044 10049 tablet_service.cc:1467] Processing CreateTablet for tablet a17e257f4a6444138c8e756b7e2eca38 (DEFAULT_TABLE table=test-table [id=9544b06f980f4922ba0299cecaa2940b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:04.914536 10049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a17e257f4a6444138c8e756b7e2eca38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:04.914588 10256 tablet_service.cc:1467] Processing CreateTablet for tablet a17e257f4a6444138c8e756b7e2eca38 (DEFAULT_TABLE table=test-table [id=9544b06f980f4922ba0299cecaa2940b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:04.914953 10256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a17e257f4a6444138c8e756b7e2eca38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:04.918690 10618 tablet_bootstrap.cc:492] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9: Bootstrap starting.
I20260812 00:01:04.918891 10617 tablet_bootstrap.cc:492] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3: Bootstrap starting.
I20260812 00:01:04.919031 10479 tablet_service.cc:1467] Processing CreateTablet for tablet a17e257f4a6444138c8e756b7e2eca38 (DEFAULT_TABLE table=test-table [id=9544b06f980f4922ba0299cecaa2940b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:04.919428 10479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a17e257f4a6444138c8e756b7e2eca38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:04.919636 10617 tablet_bootstrap.cc:654] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:04.920238 10617 log.cc:824] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:04.921247 10618 tablet_bootstrap.cc:654] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:04.921612 10617 tablet_bootstrap.cc:492] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3: No bootstrap required, opened a new log
I20260812 00:01:04.921721 10617 ts_tablet_manager.cc:1397] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:01:04.921864 10618 log.cc:824] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:04.922905 10625 tablet_bootstrap.cc:492] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9: Bootstrap starting.
I20260812 00:01:04.923218 10618 tablet_bootstrap.cc:492] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9: No bootstrap required, opened a new log
I20260812 00:01:04.923291 10618 ts_tablet_manager.cc:1397] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260812 00:01:04.924021 10625 tablet_bootstrap.cc:654] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:04.924603 10625 log.cc:824] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:04.924837 10618 raft_consensus.cc:348] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc4835a487f4cc1ac113997991ef7f9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38611 } } peers { permanent_uuid: "166f838e6fd44c9f9c626d2690a9dfa3" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 37585 } } peers { permanent_uuid: "ef5c5261690a4a93a42720d6e116d6f9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 33659 } }
I20260812 00:01:04.925009 10618 raft_consensus.cc:374] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:04.924887 10617 raft_consensus.cc:348] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc4835a487f4cc1ac113997991ef7f9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38611 } } peers { permanent_uuid: "166f838e6fd44c9f9c626d2690a9dfa3" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 37585 } } peers { permanent_uuid: "ef5c5261690a4a93a42720d6e116d6f9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 33659 } }
I20260812 00:01:04.925045 10618 raft_consensus.cc:729] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5c5261690a4a93a42720d6e116d6f9, State: Initialized, Role: FOLLOWER
I20260812 00:01:04.925060 10617 raft_consensus.cc:374] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:04.925097 10617 raft_consensus.cc:729] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 166f838e6fd44c9f9c626d2690a9dfa3, State: Initialized, Role: FOLLOWER
I20260812 00:01:04.925187 10618 consensus_queue.cc:260] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc4835a487f4cc1ac113997991ef7f9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38611 } } peers { permanent_uuid: "166f838e6fd44c9f9c626d2690a9dfa3" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 37585 } } peers { permanent_uuid: "ef5c5261690a4a93a42720d6e116d6f9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 33659 } }
I20260812 00:01:04.925235 10617 consensus_queue.cc:260] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc4835a487f4cc1ac113997991ef7f9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38611 } } peers { permanent_uuid: "166f838e6fd44c9f9c626d2690a9dfa3" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 37585 } } peers { permanent_uuid: "ef5c5261690a4a93a42720d6e116d6f9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 33659 } }
I20260812 00:01:04.925421 10625 tablet_bootstrap.cc:492] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9: No bootstrap required, opened a new log
I20260812 00:01:04.925490 10618 ts_tablet_manager.cc:1428] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:01:04.925493 10625 ts_tablet_manager.cc:1397] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:01:04.925534 10617 ts_tablet_manager.cc:1428] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260812 00:01:04.925619 10158 heartbeater.cc:503] Master 127.25.103.126:42039 was elected leader, sending a full tablet report...
I20260812 00:01:04.925657 10373 heartbeater.cc:503] Master 127.25.103.126:42039 was elected leader, sending a full tablet report...
I20260812 00:01:04.927413 10625 raft_consensus.cc:348] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc4835a487f4cc1ac113997991ef7f9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38611 } } peers { permanent_uuid: "166f838e6fd44c9f9c626d2690a9dfa3" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 37585 } } peers { permanent_uuid: "ef5c5261690a4a93a42720d6e116d6f9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 33659 } }
I20260812 00:01:04.927647 10625 raft_consensus.cc:374] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:04.927671 10625 raft_consensus.cc:729] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adc4835a487f4cc1ac113997991ef7f9, State: Initialized, Role: FOLLOWER
I20260812 00:01:04.927809 10625 consensus_queue.cc:260] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc4835a487f4cc1ac113997991ef7f9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38611 } } peers { permanent_uuid: "166f838e6fd44c9f9c626d2690a9dfa3" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 37585 } } peers { permanent_uuid: "ef5c5261690a4a93a42720d6e116d6f9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 33659 } }
I20260812 00:01:04.928158 10625 ts_tablet_manager.cc:1428] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:01:04.928221 10588 heartbeater.cc:503] Master 127.25.103.126:42039 was elected leader, sending a full tablet report...
W20260812 00:01:04.942183 10374 tablet.cc:2369] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:01:05.014199 10159 tablet.cc:2369] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:01:05.043548 10627 raft_consensus.cc:482] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:01:05.043744 10627 raft_consensus.cc:504] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc4835a487f4cc1ac113997991ef7f9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38611 } } peers { permanent_uuid: "166f838e6fd44c9f9c626d2690a9dfa3" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 37585 } } peers { permanent_uuid: "ef5c5261690a4a93a42720d6e116d6f9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 33659 } }
I20260812 00:01:05.044199 10627 leader_election.cc:288] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adc4835a487f4cc1ac113997991ef7f9 (127.25.103.67:38611), 166f838e6fd44c9f9c626d2690a9dfa3 (127.25.103.66:37585)
I20260812 00:01:05.047891 10630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:05.044480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:37585 (local address 127.25.103.65:39599)
0812 00:01:05.044712 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:05.044728 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:05.044817 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:05.044995 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:05.044997 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:05.045000 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:05.045115 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:05.045117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:05.045829 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:05.045830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:05.046846 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:05.046849 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:05.047540 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:05.047541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:05.047630 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:05.047636 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:01:05.047737 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 00:01:05.047798 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"mutex_wait_us":65,"thread_start_us":162,"threads_started":1}
I20260812 00:01:05.048136 10633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:05.044493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:38611 (local address 127.25.103.65:47977)
0812 00:01:05.044729 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:05.044742 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:05.044822 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:05.045018 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:05.045019 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:05.045022 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:05.045137 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:05.045140 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:05.045841 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:05.045843 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:05.046962 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:05.046965 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:05.047784 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:05.047785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:05.047888 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:05.047898 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 00:01:05.047983 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 00:01:05.048045 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":164,"thread_start_us":175,"threads_started":1}
I20260812 00:01:05.048003 10611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:05.044553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:39599 (local address 127.25.103.66:37585)
0812 00:01:05.044707 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:05.044709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:05.044869 (+ 160us) server_negotiation.cc:407] Connection header received
0812 00:01:05.044907 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:05.044909 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:05.044919 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:05.044961 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:05.045193 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:05.045733 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:05.046981 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:05.047420 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:05.047496 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:05.047507 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:05.047781 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 00:01:05.047891 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260812 00:01:05.048290 10610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:05.044580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:47977 (local address 127.25.103.67:38611)
0812 00:01:05.044660 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:05.044663 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:05.044815 (+ 152us) server_negotiation.cc:407] Connection header received
0812 00:01:05.044924 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:05.044925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:05.044935 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:05.045002 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:05.045220 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:05.045747 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:05.047074 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:05.047656 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:05.047738 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:05.047749 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:05.048116 (+ 367us) server_negotiation.cc:299] Negotiation successful
0812 00:01:05.048175 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:01:05.048669 10296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a17e257f4a6444138c8e756b7e2eca38" candidate_uuid: "ef5c5261690a4a93a42720d6e116d6f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "166f838e6fd44c9f9c626d2690a9dfa3" is_pre_election: true
I20260812 00:01:05.048710 10509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a17e257f4a6444138c8e756b7e2eca38" candidate_uuid: "ef5c5261690a4a93a42720d6e116d6f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adc4835a487f4cc1ac113997991ef7f9" is_pre_election: true
I20260812 00:01:05.048893 10509 raft_consensus.cc:2454] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5c5261690a4a93a42720d6e116d6f9 in term 0.
I20260812 00:01:05.048893 10296 raft_consensus.cc:2454] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5c5261690a4a93a42720d6e116d6f9 in term 0.
I20260812 00:01:05.049194 9983 leader_election.cc:302] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 166f838e6fd44c9f9c626d2690a9dfa3, ef5c5261690a4a93a42720d6e116d6f9; no voters:
I20260812 00:01:05.049443 10627 raft_consensus.cc:2781] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:01:05.049523 10627 raft_consensus.cc:482] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:01:05.049551 10627 raft_consensus.cc:3037] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:05.050450 10627 raft_consensus.cc:504] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc4835a487f4cc1ac113997991ef7f9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38611 } } peers { permanent_uuid: "166f838e6fd44c9f9c626d2690a9dfa3" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 37585 } } peers { permanent_uuid: "ef5c5261690a4a93a42720d6e116d6f9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 33659 } }
I20260812 00:01:05.050698 10627 leader_election.cc:288] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [CANDIDATE]: Term 1 election: Requested vote from peers adc4835a487f4cc1ac113997991ef7f9 (127.25.103.67:38611), 166f838e6fd44c9f9c626d2690a9dfa3 (127.25.103.66:37585)
I20260812 00:01:05.050948 10296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a17e257f4a6444138c8e756b7e2eca38" candidate_uuid: "ef5c5261690a4a93a42720d6e116d6f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "166f838e6fd44c9f9c626d2690a9dfa3"
I20260812 00:01:05.050922 10509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a17e257f4a6444138c8e756b7e2eca38" candidate_uuid: "ef5c5261690a4a93a42720d6e116d6f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adc4835a487f4cc1ac113997991ef7f9"
I20260812 00:01:05.051043 10296 raft_consensus.cc:3037] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:05.051043 10509 raft_consensus.cc:3037] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:05.052054 10509 raft_consensus.cc:2454] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5c5261690a4a93a42720d6e116d6f9 in term 1.
I20260812 00:01:05.052049 10296 raft_consensus.cc:2454] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5c5261690a4a93a42720d6e116d6f9 in term 1.
I20260812 00:01:05.052294 9983 leader_election.cc:302] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 166f838e6fd44c9f9c626d2690a9dfa3, ef5c5261690a4a93a42720d6e116d6f9; no voters:
I20260812 00:01:05.052538 10627 raft_consensus.cc:2781] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:05.052731 10627 raft_consensus.cc:686] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [term 1 LEADER]: Becoming Leader. State: Replica: ef5c5261690a4a93a42720d6e116d6f9, State: Running, Role: LEADER
I20260812 00:01:05.052846 10627 consensus_queue.cc:237] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc4835a487f4cc1ac113997991ef7f9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38611 } } peers { permanent_uuid: "166f838e6fd44c9f9c626d2690a9dfa3" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 37585 } } peers { permanent_uuid: "ef5c5261690a4a93a42720d6e116d6f9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 33659 } }
I20260812 00:01:05.053788 9854 catalog_manager.cc:5495] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5c5261690a4a93a42720d6e116d6f9 (127.25.103.65). New cstate: current_term: 1 leader_uuid: "ef5c5261690a4a93a42720d6e116d6f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc4835a487f4cc1ac113997991ef7f9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "166f838e6fd44c9f9c626d2690a9dfa3" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 37585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5c5261690a4a93a42720d6e116d6f9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 33659 } health_report { overall_health: HEALTHY } } }
I20260812 00:01:05.061146 10615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:05.058739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52670 (local address 127.25.103.65:33659)
0812 00:01:05.058796 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:05.058798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:05.058807 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:01:05.058849 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:05.058850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:05.058881 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:05.058948 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:01:05.059082 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:05.059614 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:05.060353 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:05.060557 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:05.060614 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:05.060774 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:01:05.060920 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:01:05.060998 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:05.061034 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 00:01:05.061057 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:01:05.064651 10509 raft_consensus.cc:1261] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9 [term 1 FOLLOWER]: Refusing update from remote peer ef5c5261690a4a93a42720d6e116d6f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:01:05.064698 10296 raft_consensus.cc:1261] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3 [term 1 FOLLOWER]: Refusing update from remote peer ef5c5261690a4a93a42720d6e116d6f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:01:05.065269 10634 consensus_queue.cc:1035] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adc4835a487f4cc1ac113997991ef7f9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:01:05.065448 10627 consensus_queue.cc:1035] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "166f838e6fd44c9f9c626d2690a9dfa3" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 37585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:01:05.070147 10644 mvcc.cc:205] Tried to move back new op lower bound from 7317474775301353472 to 7317474775257120768. Current Snapshot: MvccSnapshot[applied={T|T < 7317474775301353472}]
I20260812 00:01:05.070261 10645 mvcc.cc:205] Tried to move back new op lower bound from 7317474775301353472 to 7317474775257120768. Current Snapshot: MvccSnapshot[applied={T|T < 7317474775301353472}]
I20260812 00:01:05.070973 10639 mvcc.cc:205] Tried to move back new op lower bound from 7317474775301353472 to 7317474775257120768. Current Snapshot: MvccSnapshot[applied={T|T < 7317474775301353472 or (T in {7317474775301353472})}]
I20260812 00:01:05.072508 9854 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:01:05.072641 9854 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:01:05.073711 9854 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 826f985f78cc458ca03750a6d05a2b83: Sending DeleteTablet for 3 replicas of tablet a17e257f4a6444138c8e756b7e2eca38
I20260812 00:01:05.074213 10479 tablet_service.cc:1514] Processing DeleteTablet for tablet a17e257f4a6444138c8e756b7e2eca38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:05 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:47108
I20260812 00:01:05.074210 10049 tablet_service.cc:1514] Processing DeleteTablet for tablet a17e257f4a6444138c8e756b7e2eca38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:05 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:52668
I20260812 00:01:05.074517 10656 tablet_replica.cc:330] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9: stopping tablet replica
I20260812 00:01:05.074503 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 9958
I20260812 00:01:05.074541 10256 tablet_service.cc:1514] Processing DeleteTablet for tablet a17e257f4a6444138c8e756b7e2eca38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:05 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:40982
I20260812 00:01:05.074620 10656 raft_consensus.cc:2229] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:01:05.074762 10656 raft_consensus.cc:2258] T a17e257f4a6444138c8e756b7e2eca38 P ef5c5261690a4a93a42720d6e116d6f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:05.074901 10655 tablet_replica.cc:330] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9: stopping tablet replica
I20260812 00:01:05.075114 10655 raft_consensus.cc:2229] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:01:05.075232 10655 raft_consensus.cc:2258] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:05.077751 10657 tablet_replica.cc:330] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3: stopping tablet replica
I20260812 00:01:05.077862 10657 raft_consensus.cc:2229] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:01:05.077870 10655 ts_tablet_manager.cc:1905] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:01:05.077981 10657 raft_consensus.cc:2258] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:05.078392 10657 ts_tablet_manager.cc:1905] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:01:05.079655 10657 ts_tablet_manager.cc:1918] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:01:05.079711 10657 log.cc:1196] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/a17e257f4a6444138c8e756b7e2eca38
I20260812 00:01:05.079793 10655 ts_tablet_manager.cc:1918] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:01:05.079882 10655 log.cc:1196] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/a17e257f4a6444138c8e756b7e2eca38
I20260812 00:01:05.079907 10657 ts_tablet_manager.cc:1939] T a17e257f4a6444138c8e756b7e2eca38 P 166f838e6fd44c9f9c626d2690a9dfa3: Deleting consensus metadata
I20260812 00:01:05.080200 10655 ts_tablet_manager.cc:1939] T a17e257f4a6444138c8e756b7e2eca38 P adc4835a487f4cc1ac113997991ef7f9: Deleting consensus metadata
I20260812 00:01:05.080399 9834 catalog_manager.cc:4841] TS 166f838e6fd44c9f9c626d2690a9dfa3 (127.25.103.66:37585): tablet a17e257f4a6444138c8e756b7e2eca38 (table test-table [id=9544b06f980f4922ba0299cecaa2940b]) successfully deleted
I20260812 00:01:05.080734 9833 catalog_manager.cc:4841] TS adc4835a487f4cc1ac113997991ef7f9 (127.25.103.67:38611): tablet a17e257f4a6444138c8e756b7e2eca38 (table test-table [id=9544b06f980f4922ba0299cecaa2940b]) successfully deleted
W20260812 00:01:05.091796 9830 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.103.65:33659 (error 108)
I20260812 00:01:05.092144 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 10165
I20260812 00:01:05.092432 10607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:05.092306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:33659 (local address 127.0.0.1:52682)
0812 00:01:05.092362 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:05.092397 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:33659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 00:01:05.092548 9830 catalog_manager.cc:4584] TS ef5c5261690a4a93a42720d6e116d6f9 (127.25.103.65:33659): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a17e257f4a6444138c8e756b7e2eca38: Network error: Client connection negotiation failed: client connection to 127.25.103.65:33659: connect: Connection refused (error 111)
I20260812 00:01:05.110469 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 10382
I20260812 00:01:05.128937 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 9803
2026-08-12T00:01:05Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2370 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:01:05 dist-test-slave-vpvm krb5kdc[10664](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:01:05 dist-test-slave-vpvm krb5kdc[10664](info): set up 2 sockets
Aug 12 00:01:05 dist-test-slave-vpvm krb5kdc[10664](info): commencing operation
krb5kdc: starting...
W20260812 00:01:06.368379 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:01:06 dist-test-slave-vpvm krb5kdc[10664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492866, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:01:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:01:06Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.25.103.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.25.103.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.25.103.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/rangeradmin_127.25.103.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.25.103.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/rangeradmin_127.25.103.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.25.103.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.25.103.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.25.103.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/rangerlookup_127.25.103.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.25.103.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/rangerlookup_127.25.103.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.103.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.25.103.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.103.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/HTTP_127.25.103.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.103.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/HTTP_127.25.103.84@KRBTEST.COM.keytab.
I20260812 00:01:06.576918 26013 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskdkQn2d/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/postgres -l logfile start
2026-08-12 00:01:09.525 UTC [10720] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 00:01:09.525 UTC [10720] LOG: listening on IPv4 address "127.25.103.84", port 33879
2026-08-12 00:01:09.531 UTC [10720] LOG: listening on Unix socket "/tmp/.s.PGSQL.33879"
2026-08-12 00:01:09.555 UTC [10725] LOG: database system was shut down at 2026-08-12 00:01:07 UTC
2026-08-12 00:01:09.561 UTC [10720] LOG: database system is ready to accept connections
I20260812 00:01:10.726824 26013 mini_postgres.cc:96] Postgres bound to 33879
2026-08-12 00:01:10.734 UTC [10736] FATAL: database "slave" does not exist
127.25.103.84:33879 - accepting connections
I20260812 00:01:10.734787 26013 mini_ranger.cc:161] Starting Ranger...
I20260812 00:01:10.751832 26013 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 00:01:11.327178 26013 mini_ranger.cc:87] Created ranger Postgres database
I20260812 00:01:11.327263 26013 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ranger-admin
2026-08-12 00:01:11,634 [I] DB FLAVOR :POSTGRES
2026-08-12 00:01:11,635 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:01:11,635 [I] Checking connection..
2026-08-12 00:01:11,635 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 00:01:11,937 [I] Checking connection passed.
2026-08-12 00:01:11,938 [I] --------- Verifying version history table ---------
2026-08-12 00:01:11,938 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:01:12,247 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:01:12,248 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:01:12,561 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:01:12,561 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 00:01:12,561 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 00:01:12.839 UTC [10838] WARNING: there is no transaction in progress
2026-08-12 00:01:12,849 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 00:01:12,850 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:01:13,162 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 00:01:13,162 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:01:13,162 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 00:01:13,469 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 00:01:13,775 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-vpvm.c.gcp-upstream.internal','N') ;"
2026-08-12 00:01:14,065 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:01:14,375 [I] Table x_portal_user does not exist in database ranger
2026-08-12 00:01:14,375 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:01:14,678 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 00:01:14,678 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:01:14,990 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:01:15,284 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 00:01:15,284 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 00:01:16.559 UTC [11011] WARNING: there is no transaction in progress
2026-08-12 00:01:16.579 UTC [11011] WARNING: there is no transaction in progress
2026-08-12 00:01:16.599 UTC [11011] WARNING: there is no transaction in progress
2026-08-12 00:01:16.619 UTC [11011] WARNING: there is no transaction in progress
2026-08-12 00:01:16.640 UTC [11011] WARNING: there is no transaction in progress
2026-08-12 00:01:16.662 UTC [11011] WARNING: there is no transaction in progress
2026-08-12 00:01:16.742 UTC [11011] WARNING: there is no transaction in progress
2026-08-12 00:01:16.751 UTC [11011] WARNING: there is no transaction in progress
2026-08-12 00:01:16.770 UTC [11011] WARNING: there is no transaction in progress
2026-08-12 00:01:16.783 UTC [11011] WARNING: there is no transaction in progress
2026-08-12 00:01:16.795 UTC [11011] WARNING: there is no transaction in progress
2026-08-12 00:01:16.813 UTC [11011] WARNING: there is no transaction in progress
2026-08-12 00:01:16.826 UTC [11011] WARNING: there is no transaction in progress
2026-08-12 00:01:16.834 UTC [11011] WARNING: there is no transaction in progress
2026-08-12 00:01:16.841 UTC [11011] WARNING: there is no transaction in progress
2026-08-12 00:01:16.851 UTC [11011] WARNING: there is no transaction in progress
2026-08-12 00:01:17,842 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 00:01:17,842 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 00:01:18,154 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 00:01:18,154 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:01:18,477 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 00:01:18,478 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:01:18,799 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 00:01:18,800 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:01:19,079 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:01:19,367 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-vpvm.c.gcp-upstream.internal';"
2026-08-12 00:01:19,645 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 00:01:19,646 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 00:01:19,967 [I] DB_PATCHES have already been applied
I20260812 00:01:19.974220 26013 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ranger-admin:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskdkQn2d/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 00:01:19.974299 26013 mini_ranger.cc:193] Using host: 127.25.103.84
I20260812 00:01:19.979568 26013 mini_ranger.cc:227] Ranger admin URL: http://127.25.103.84:38149
Aug 12, 2026 12:01:20 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:01:20 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:01:20 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 12:01:20 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 12:01:20 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 12:01:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 12:01:21 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 00:01:21.269814 26013 mini_ranger.cc:160] Time spent starting Ranger: real 10.535s user 0.003s sys 0.010s
Aug 12, 2026 12:01:46 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 12:01:46 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 12:01:46 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 12:01:46 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 12:01:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 12:01:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 12:01:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 12:01:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 12:01:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 12:01:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 12:01:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 12:01:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 12:01:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 12:01:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 12:01:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 12:01:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 12:01:46 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 12:01:47 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 00:01:47.883903 26013 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.25.103.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.25.103.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.25.103.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/rangerkms_127.25.103.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.25.103.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/rangerkms_127.25.103.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.103.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.25.103.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.103.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/HTTP_127.25.103.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.103.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/HTTP_127.25.103.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 00:01:47 dist-test-slave-vpvm krb5kdc[10664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492907, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 00:01:47.986477 26013 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 00:01:48.001217 26013 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 00:01:48.809882 26013 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 00:01:48.810066 26013 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ranger-kms
I20260812 00:01:48.810084 26013 mini_ranger_kms.cc:227] Using postgres at 127.25.103.84:33879
2026-08-12 00:01:49,467 [I] DB FLAVOR :POSTGRES
2026-08-12 00:01:49,467 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:01:49,467 [I] Checking connection
2026-08-12 00:01:49,467 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 00:01:49,752 [I] connection success
2026-08-12 00:01:49,752 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 00:01:49,752 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 00:01:49,752 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 00:01:50,066 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 00:01:50,067 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:01:50,067 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 00:01:50,067 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:33879/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 00:01:50,379 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 00:01:50.995684 26013 mini_ranger_kms.cc:310] Created kms service
I20260812 00:01:51.240463 26013 mini_ranger_kms.cc:326] Created kudu user
I20260812 00:01:51.302507 26013 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 00:01:51 dist-test-slave-vpvm krb5kdc[10664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492907, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
I20260812 00:01:51.834336 26013 mini_ranger_kms.cc:384] Added ranger policy
I20260812 00:01:51.834472 26013 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ranger-kms:/tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 00:01:51.834494 26013 mini_ranger_kms.cc:240] Using host: 127.25.103.84
I20260812 00:01:51.839583 26013 mini_ranger_kms.cc:276] Ranger KMS PID: 11312
I20260812 00:01:51.839741 26013 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.25.103.84:42443
Aug 12, 2026 12:01:52 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:01:52 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:01:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 12:01:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 12:01:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 12:01:53 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 00:01:54 dist-test-slave-vpvm krb5kdc[10664](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786492914, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.103.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:54.403810 26013 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.417s user 0.022s sys 0.270s
I20260812 00:01:54.403939 26013 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 00:01:54.404026 26013 mini_ranger_kms.cc:401] 127.25.103.84:42443/kms/v1/keys
Aug 12 00:01:54 dist-test-slave-vpvm krb5kdc[10664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492914, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.103.84@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
Aug 12 00:01:55 dist-test-slave-vpvm krb5kdc[10664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492914, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.103.84@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
Aug 12 00:01:57 dist-test-slave-vpvm krb5kdc[10664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:01:58.004913 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:45341
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:36275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:45341
--ranger_config_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.103.84:42443/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:58.131531 11406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:58.131855 11406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:58.131882 11406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:58.133491 11406 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:01:58.133553 11406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:58.133566 11406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:58.133579 11406 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:01:58.133590 11406 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:01:58.136981 11406 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:36275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/master-0/wal
--ranger_kms_url=127.25.103.84:42443/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:45341
--ranger_config_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:45341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:01:58.137311 11406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:58.137579 11406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:58.144897 11417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:58.144963 11418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:58.144991 11421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:58.145466 11406 server_base.cc:1034] running on GCE node
I20260812 00:01:58.145789 11406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:58.146173 11406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:58.147394 11406 hybrid_clock.cc:648] HybridClock initialized: now 1786492918147357 us; error 50 us; skew 500 ppm
Aug 12 00:01:58 dist-test-slave-vpvm krb5kdc[10664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492918, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:58.155350 11406 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:01:58.155947 11406 webserver.cc:460] Webserver started at http://127.25.103.126:38793/ using document root <none> and password file <none>
I20260812 00:01:58.156177 11406 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:58.156220 11406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:58.156356 11406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:01:58 dist-test-slave-vpvm krb5kdc[10664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492918, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
I20260812 00:01:58.220589 11406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "d10fc8edf84c4fbf8c20cbd8e0711fcf"
format_stamp: "Formatted at 2026-08-12 00:01:58 on dist-test-slave-vpvm"
server_key: "c95f43b1712009f6ea6ec07fa768c1fa"
server_key_iv: "7164dd26540a68082a97f39391797b33"
server_key_version: "kuduclusterkey@0"
I20260812 00:01:58.221110 11406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "d10fc8edf84c4fbf8c20cbd8e0711fcf"
format_stamp: "Formatted at 2026-08-12 00:01:58 on dist-test-slave-vpvm"
server_key: "c95f43b1712009f6ea6ec07fa768c1fa"
server_key_iv: "7164dd26540a68082a97f39391797b33"
server_key_version: "kuduclusterkey@0"
I20260812 00:01:58.222664 11406 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:01:58.235647 11432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:58.235859 11406 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:01:58.235962 11406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "d10fc8edf84c4fbf8c20cbd8e0711fcf"
format_stamp: "Formatted at 2026-08-12 00:01:58 on dist-test-slave-vpvm"
server_key: "c95f43b1712009f6ea6ec07fa768c1fa"
server_key_iv: "7164dd26540a68082a97f39391797b33"
server_key_version: "kuduclusterkey@0"
I20260812 00:01:58.236063 11406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:58.252595 11406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:58.256137 11406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:58.256297 11406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:58.271561 11406 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:45341
I20260812 00:01:58.271752 11523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:45341 every 8 connection(s)
I20260812 00:01:58.272440 11406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:01:58.273702 11524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:58.275233 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 11406
I20260812 00:01:58.275360 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:01:58.275588 26013 external_mini_cluster.cc:1428] Setting key e375699b5b0a23dcc044ea558d42ebd0
I20260812 00:01:58.279548 11524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf: Bootstrap starting.
I20260812 00:01:58.281629 11524 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:58.282665 11524 log.cc:824] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:58.283983 11524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf: No bootstrap required, opened a new log
Aug 12 00:01:58 dist-test-slave-vpvm krb5kdc[10664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:01:58.288931 11524 raft_consensus.cc:348] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d10fc8edf84c4fbf8c20cbd8e0711fcf" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45341 } }
I20260812 00:01:58.289187 11524 raft_consensus.cc:374] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:58.289237 11524 raft_consensus.cc:729] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d10fc8edf84c4fbf8c20cbd8e0711fcf, State: Initialized, Role: FOLLOWER
I20260812 00:01:58.289494 11524 consensus_queue.cc:260] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d10fc8edf84c4fbf8c20cbd8e0711fcf" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45341 } }
I20260812 00:01:58.289610 11524 raft_consensus.cc:388] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:01:58.289693 11524 raft_consensus.cc:482] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:01:58.289918 11524 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:58.291426 11524 raft_consensus.cc:504] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d10fc8edf84c4fbf8c20cbd8e0711fcf" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45341 } }
I20260812 00:01:58.291577 11524 leader_election.cc:302] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d10fc8edf84c4fbf8c20cbd8e0711fcf; no voters:
I20260812 00:01:58.291831 11524 leader_election.cc:288] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:01:58.291987 11535 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:58.292318 11535 raft_consensus.cc:686] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf [term 1 LEADER]: Becoming Leader. State: Replica: d10fc8edf84c4fbf8c20cbd8e0711fcf, State: Running, Role: LEADER
I20260812 00:01:58.292325 11524 sys_catalog.cc:564] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:01:58.292559 11535 consensus_queue.cc:237] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d10fc8edf84c4fbf8c20cbd8e0711fcf" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45341 } }
I20260812 00:01:58.292649 11531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:58.276696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47092 (local address 127.25.103.126:45341)
0812 00:01:58.277101 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:58.277113 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:58.277185 (+ 72us) server_negotiation.cc:407] Connection header received
0812 00:01:58.278207 (+ 1022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:58.278219 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:58.278302 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:58.278528 (+ 226us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:58.279368 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:58.281225 (+ 1857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:58.282388 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:58.283174 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:58.283295 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:58.286978 (+ 3683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:58.286985 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:58.286986 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:58.287001 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:58.290255 (+ 3254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:58.290759 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:58.290763 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:58.290763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:58.290876 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:58.291130 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:58.291131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:58.291131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:58.291501 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:58.292188 (+ 687us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:58.292269 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 00:01:58.292405 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":127,"threads_started":1}
I20260812 00:01:58.294541 11542 sys_catalog.cc:455] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf [sys.catalog]: SysCatalogTable state changed. Reason: New leader d10fc8edf84c4fbf8c20cbd8e0711fcf. Latest consensus state: current_term: 1 leader_uuid: "d10fc8edf84c4fbf8c20cbd8e0711fcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d10fc8edf84c4fbf8c20cbd8e0711fcf" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45341 } } }
I20260812 00:01:58.294823 11542 sys_catalog.cc:458] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:58.294525 11536 sys_catalog.cc:455] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d10fc8edf84c4fbf8c20cbd8e0711fcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d10fc8edf84c4fbf8c20cbd8e0711fcf" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45341 } } }
I20260812 00:01:58.295480 11536 sys_catalog.cc:458] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:58.296518 11524 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 00:01:58.300508 11554 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:01:58.302125 11554 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:01:58.306524 11554 catalog_manager.cc:1347] Generated new cluster ID: 8d75aaf9bf374c628e00fc51ef6e3659
I20260812 00:01:58.306707 11554 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:01:58.365556 11554 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:01:58.366433 11554 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:01:58.383163 11554 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf: Generated new TSK 0
I20260812 00:01:58.383533 11554 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
I20260812 00:01:59.509341 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.103.84:42443/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:45341
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:36275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:59.684724 11610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:59.684993 11610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:59.685021 11610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:59.687072 11610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:59.687166 11610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:59.687202 11610 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:01:59.689440 11610 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:36275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.25.103.84:42443/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:45341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:01:59.689723 11610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:59.690042 11610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:59.698333 11618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:59.698654 11616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:59.698295 11621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:59.699393 11610 server_base.cc:1034] running on GCE node
I20260812 00:01:59.699658 11610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:59.699945 11610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:59.701189 11610 hybrid_clock.cc:648] HybridClock initialized: now 1786492919701161 us; error 43 us; skew 500 ppm
Aug 12 00:01:59 dist-test-slave-vpvm krb5kdc[10664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492919, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:59.705204 11610 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:01:59.705770 11610 webserver.cc:460] Webserver started at http://127.25.103.65:41469/ using document root <none> and password file <none>
I20260812 00:01:59.706046 11610 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:59.706103 11610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:59.706247 11610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:01:59 dist-test-slave-vpvm krb5kdc[10664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492919, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
I20260812 00:01:59.720882 11610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "f2ad6343e7f74bab8331738dbfe7c051"
format_stamp: "Formatted at 2026-08-12 00:01:59 on dist-test-slave-vpvm"
server_key: "c240bd67ceef9c3908720f124d2c3c4f"
server_key_iv: "2266e955a29bdb3eb4865e651e58d90d"
server_key_version: "kuduclusterkey@0"
I20260812 00:01:59.721549 11610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "f2ad6343e7f74bab8331738dbfe7c051"
format_stamp: "Formatted at 2026-08-12 00:01:59 on dist-test-slave-vpvm"
server_key: "c240bd67ceef9c3908720f124d2c3c4f"
server_key_iv: "2266e955a29bdb3eb4865e651e58d90d"
server_key_version: "kuduclusterkey@0"
I20260812 00:01:59.724138 11610 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.003s
I20260812 00:01:59.748498 11629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:59.748811 11610 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260812 00:01:59.748922 11610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "f2ad6343e7f74bab8331738dbfe7c051"
format_stamp: "Formatted at 2026-08-12 00:01:59 on dist-test-slave-vpvm"
server_key: "c240bd67ceef9c3908720f124d2c3c4f"
server_key_iv: "2266e955a29bdb3eb4865e651e58d90d"
server_key_version: "kuduclusterkey@0"
I20260812 00:01:59.749032 11610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:59.779719 11610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:59.782334 11610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:59.782547 11610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:59.782878 11610 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:59.783339 11610 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:59.783384 11610 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:59.783418 11610 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:59.783458 11610 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:59.804574 11610 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:42903
I20260812 00:01:59.805099 11610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:01:59.805356 11837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:42903 every 8 connection(s)
I20260812 00:01:59.809387 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 11610
I20260812 00:01:59.809533 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:01:59.809773 26013 external_mini_cluster.cc:1428] Setting key e86a974de4c5b6132258253867061665
Aug 12 00:01:59 dist-test-slave-vpvm krb5kdc[10664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492919, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:01:59.824117 11844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:59.806164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:45341 (local address 127.25.103.65:45965)
0812 00:01:59.809235 (+ 3071us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:59.809305 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:59.810622 (+ 1317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:59.811014 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:59.811019 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:59.811494 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:59.811928 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:59.811936 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:59.812980 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:59.812982 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:59.814380 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:59.814384 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:59.814791 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:59.814792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:59.814998 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:59.815865 (+ 867us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:59.815880 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:59.818661 (+ 2781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:59.821933 (+ 3272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:59.821973 (+ 40us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:59.821977 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:59.822398 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:59.822663 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:59.822663 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:59.822664 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:59.822824 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:59.823200 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:59.823208 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:59.823410 (+ 202us) client_negotiation.cc:769] Sending connection context
0812 00:01:59.823529 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 00:01:59.823732 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2974,"thread_start_us":198,"threads_started":1}
I20260812 00:01:59.824903 11842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:59.806201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:45965 (local address 127.25.103.126:45341)
0812 00:01:59.806466 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:59.806468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:59.809534 (+ 3066us) server_negotiation.cc:407] Connection header received
0812 00:01:59.810744 (+ 1210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:59.810745 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:59.810761 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:59.810914 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:59.812057 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:59.812806 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:59.814482 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:59.814707 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:59.814770 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:59.819013 (+ 4243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:59.819016 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:59.819016 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:59.819030 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:59.821765 (+ 2735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:59.822508 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:59.822509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:59.822510 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:59.822592 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:59.822914 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:59.822916 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:59.822916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:59.823086 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:59.823168 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:59.824664 (+ 1496us) server_negotiation.cc:299] Negotiation successful
0812 00:01:59.824781 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":156,"threads_started":1}
I20260812 00:01:59.825871 11839 heartbeater.cc:347] Connected to a master server at 127.25.103.126:45341
I20260812 00:01:59.826094 11839 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:59.826330 11839 heartbeater.cc:511] Master 127.25.103.126:45341 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.25.103.66@KRBTEST.COM; defaulting to no policy
I20260812 00:01:59.827013 11461 ts_manager.cc:194] Registered new tserver with Master: f2ad6343e7f74bab8331738dbfe7c051 (127.25.103.65:42903)
I20260812 00:01:59.828059 11461 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:45965
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
I20260812 00:01:59.853727 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.103.84:42443/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:45341
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:36275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:00.052279 11848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:00.052646 11848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:00.052695 11848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:00.055258 11848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:00.055526 11848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:00.055675 11848 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:02:00.059079 11848 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:36275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.25.103.84:42443/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:45341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:02:00.059562 11848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:00.059924 11848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:00.091730 11862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:00.092206 11858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:00.092902 11848 server_base.cc:1034] running on GCE node
W20260812 00:02:00.101311 11856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:00.101748 11848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:00.102157 11848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:00.103314 11848 hybrid_clock.cc:648] HybridClock initialized: now 1786492920103282 us; error 44 us; skew 500 ppm
Aug 12 00:02:00 dist-test-slave-vpvm krb5kdc[10664](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786492920, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 12 00:02:00 dist-test-slave-vpvm krb5kdc[10664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492920, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:00.107064 11848 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:02:00.107657 11848 webserver.cc:460] Webserver started at http://127.25.103.66:45077/ using document root <none> and password file <none>
I20260812 00:02:00.107925 11848 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:00.107980 11848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:00.108155 11848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:02:00 dist-test-slave-vpvm krb5kdc[10664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492920, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
I20260812 00:02:00.123534 11848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "055ab9ab5252483e9ecd154727076ae5"
format_stamp: "Formatted at 2026-08-12 00:02:00 on dist-test-slave-vpvm"
server_key: "4852bf19388ae39dbd63ec08c21b64c4"
server_key_iv: "094edec3b8c6dc115453fee2d7d01438"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:00.123980 11848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "055ab9ab5252483e9ecd154727076ae5"
format_stamp: "Formatted at 2026-08-12 00:02:00 on dist-test-slave-vpvm"
server_key: "4852bf19388ae39dbd63ec08c21b64c4"
server_key_iv: "094edec3b8c6dc115453fee2d7d01438"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:00.125711 11848 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:02:00.158617 11874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:00.162474 11848 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260812 00:02:00.162640 11848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "055ab9ab5252483e9ecd154727076ae5"
format_stamp: "Formatted at 2026-08-12 00:02:00 on dist-test-slave-vpvm"
server_key: "4852bf19388ae39dbd63ec08c21b64c4"
server_key_iv: "094edec3b8c6dc115453fee2d7d01438"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:00.162774 11848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:00.182304 11848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:00.186239 11848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:00.186417 11848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:00.186806 11848 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:00.187440 11848 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:00.187511 11848 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:00.187613 11848 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:00.187651 11848 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:00.208964 11848 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:39751
I20260812 00:02:00.209573 11848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:02:00.209074 12052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:39751 every 8 connection(s)
I20260812 00:02:00.212894 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 11848
I20260812 00:02:00.214051 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:02:00.214332 26013 external_mini_cluster.cc:1428] Setting key 6278953312a0c9b79749c622e8314eee
Aug 12 00:02:00 dist-test-slave-vpvm krb5kdc[10664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492920, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:02:00.225489 11842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.211863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:60759 (local address 127.25.103.126:45341)
0812 00:02:00.211923 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:00.211926 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:00.211939 (+ 13us) server_negotiation.cc:407] Connection header received
0812 00:02:00.212990 (+ 1051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:00.212992 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:00.213011 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:00.213062 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:00.214816 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.215617 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.217522 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.217843 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.217927 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.221336 (+ 3409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:00.221338 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:00.221338 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:00.221347 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:00.223140 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:00.223916 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:00.223918 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:00.223918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:00.223986 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:00.224324 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:00.224325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:00.224326 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:00.224483 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:00.224530 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:00.225249 (+ 719us) server_negotiation.cc:299] Negotiation successful
0812 00:02:00.225372 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 00:02:00.226133 12056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.211262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:45341 (local address 127.25.103.66:60759)
0812 00:02:00.211738 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:00.211796 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:00.212839 (+ 1043us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:00.213314 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:00.213320 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:00.213833 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:00.214476 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:00.214485 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.215775 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.215777 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:00.217381 (+ 1604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:00.217387 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.217981 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.217982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:00.218228 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.218958 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:00.218969 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:00.221201 (+ 2232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:00.223250 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:00.223259 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:00.223262 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:00.223811 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:00.224080 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:00.224081 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:00.224081 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:00.224239 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:00.224670 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:00.224677 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:00.224879 (+ 202us) client_negotiation.cc:769] Sending connection context
0812 00:02:00.225599 (+ 720us) client_negotiation.cc:240] Negotiation successful
0812 00:02:00.225790 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":286,"threads_started":1}
I20260812 00:02:00.228734 12053 heartbeater.cc:347] Connected to a master server at 127.25.103.126:45341
I20260812 00:02:00.228866 12053 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:00.229113 12053 heartbeater.cc:511] Master 127.25.103.126:45341 requested a full tablet report, sending...
I20260812 00:02:00.229717 11461 ts_manager.cc:194] Registered new tserver with Master: 055ab9ab5252483e9ecd154727076ae5 (127.25.103.66:39751)
I20260812 00:02:00.230278 11461 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:60759
WARNING: no policy specified for kudu/127.25.103.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
I20260812 00:02:00.271173 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.103.84:42443/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:45341
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:36275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:00.448228 12062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:00.448649 12062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:00.448763 12062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:00.450678 12062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:00.450804 12062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:00.450909 12062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:02:00.453553 12062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:36275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.25.103.84:42443/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:45341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:02:00.454072 12062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:00.454522 12062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:02:00.465693 12062 server_base.cc:1034] running on GCE node
W20260812 00:02:00.465739 12072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:00.466940 12071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:00.466955 12075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:00.467329 12062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:00.467607 12062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:00.468828 12062 hybrid_clock.cc:648] HybridClock initialized: now 1786492920468805 us; error 39 us; skew 500 ppm
Aug 12 00:02:00 dist-test-slave-vpvm krb5kdc[10664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492920, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:00.471838 12062 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:02:00.472332 12062 webserver.cc:460] Webserver started at http://127.25.103.67:41315/ using document root <none> and password file <none>
I20260812 00:02:00.472554 12062 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:00.472602 12062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:00.472739 12062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:02:00 dist-test-slave-vpvm krb5kdc[10664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492920, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
I20260812 00:02:00.486353 12062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "d03a7a8648eb4c2d8f3aa4a3486df202"
format_stamp: "Formatted at 2026-08-12 00:02:00 on dist-test-slave-vpvm"
server_key: "674e7d7f812539c95a914b9d903780ad"
server_key_iv: "061774bb364d616ab267f6e527c3efd1"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:00.486928 12062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "d03a7a8648eb4c2d8f3aa4a3486df202"
format_stamp: "Formatted at 2026-08-12 00:02:00 on dist-test-slave-vpvm"
server_key: "674e7d7f812539c95a914b9d903780ad"
server_key_iv: "061774bb364d616ab267f6e527c3efd1"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:00.489176 12062 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260812 00:02:00.504700 12084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:00.504905 12062 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:02:00.505000 12062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "d03a7a8648eb4c2d8f3aa4a3486df202"
format_stamp: "Formatted at 2026-08-12 00:02:00 on dist-test-slave-vpvm"
server_key: "674e7d7f812539c95a914b9d903780ad"
server_key_iv: "061774bb364d616ab267f6e527c3efd1"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:00.505110 12062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:00.517542 12062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:00.519877 12062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:00.520073 12062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:00.520370 12062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:00.520764 12062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:00.520815 12062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:00.520850 12062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:00.520877 12062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:00.539233 12062 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:38701
I20260812 00:02:00.539561 12279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:38701 every 8 connection(s)
I20260812 00:02:00.539752 12062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:02:00.542366 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 12062
I20260812 00:02:00.542464 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:02:00.542701 26013 external_mini_cluster.cc:1428] Setting key 4d645755ab0f13e370bb61b7ba1daa87
Aug 12 00:02:00 dist-test-slave-vpvm krb5kdc[10664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492920, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:02:00.552701 11842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.541121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:57689 (local address 127.25.103.126:45341)
0812 00:02:00.541181 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:00.541183 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:00.541325 (+ 142us) server_negotiation.cc:407] Connection header received
0812 00:02:00.542534 (+ 1209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:00.542536 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:00.542552 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:00.542625 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:00.543849 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.544370 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.546156 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.546462 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.546536 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.549721 (+ 3185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:00.549723 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:00.549723 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:00.549731 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:00.551235 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:00.551685 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:00.551686 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:00.551687 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:00.551749 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:00.552007 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:00.552008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:00.552008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:00.552139 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:00.552205 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:00.552505 (+ 300us) server_negotiation.cc:299] Negotiation successful
0812 00:02:00.552598 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:02:00.552975 12284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.540804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:45341 (local address 127.25.103.67:57689)
0812 00:02:00.541146 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:00.541199 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:00.542383 (+ 1184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:00.542714 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:00.542719 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:00.543258 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:00.543747 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:00.543756 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.544469 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.544470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:00.546051 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:00.546055 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.546560 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.546561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:00.546778 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.547495 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:00.547507 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:00.549583 (+ 2076us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:00.551333 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:00.551342 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:00.551346 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:00.551609 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:00.551812 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:00.551813 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:00.551814 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:00.551944 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:00.552202 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:00.552210 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:00.552374 (+ 164us) client_negotiation.cc:769] Sending connection context
0812 00:02:00.552478 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 00:02:00.552646 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":172,"threads_started":1}
I20260812 00:02:00.558120 12280 heartbeater.cc:347] Connected to a master server at 127.25.103.126:45341
I20260812 00:02:00.558254 12280 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:00.558465 12280 heartbeater.cc:511] Master 127.25.103.126:45341 requested a full tablet report, sending...
I20260812 00:02:00.558884 11461 ts_manager.cc:194] Registered new tserver with Master: d03a7a8648eb4c2d8f3aa4a3486df202 (127.25.103.67:38701)
I20260812 00:02:00.559260 11461 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:57689
I20260812 00:02:00.565189 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:02:00.580646 11842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.570392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32792 (local address 127.25.103.126:45341)
0812 00:02:00.570447 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:00.570449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:00.571810 (+ 1361us) server_negotiation.cc:407] Connection header received
0812 00:02:00.571943 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:00.571945 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:00.571958 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:00.571993 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:00.572911 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.573730 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.575232 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.575552 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.575633 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.577550 (+ 1917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:00.577552 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:00.577553 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:00.577561 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:00.579294 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:00.579707 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:00.579709 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:00.579709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:00.579772 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:00.580006 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:00.580007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:00.580007 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:00.580151 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:00.580225 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:00.580459 (+ 234us) server_negotiation.cc:299] Negotiation successful
0812 00:02:00.580546 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:02:00.583104 11461 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32792:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:02:00.586004 11461 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:02:00.602406 12300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.595480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:39751 (local address 127.0.0.1:48200)
0812 00:02:00.596685 (+ 1205us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:00.596730 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:00.596810 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:00.597240 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:00.597244 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:00.597246 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:00.597322 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:00.597324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.599005 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.599007 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:00.600437 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:00.600441 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.602025 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.602026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:00.602161 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.602170 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 00:02:00.602249 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 00:02:00.602305 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1165,"mutex_wait_us":57,"thread_start_us":116,"threads_started":1}
I20260812 00:02:00.602819 12308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.596085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48200 (local address 127.25.103.66:39751)
0812 00:02:00.596486 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:00.596491 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:00.596795 (+ 304us) server_negotiation.cc:407] Connection header received
0812 00:02:00.596943 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:00.596946 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:00.596964 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:00.597043 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:00.597411 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.598906 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.600706 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.601710 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.601781 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.601985 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:00.602649 (+ 664us) server_negotiation.cc:299] Negotiation successful
0812 00:02:00.602699 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":118,"threads_started":1}
I20260812 00:02:00.603744 11945 tablet_service.cc:1467] Processing CreateTablet for tablet a8fe28c8cc5e4065b5d8d63a4c517019 (DEFAULT_TABLE table=test-table [id=bbf293df08854914846187460057079a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:00.604203 11945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8fe28c8cc5e4065b5d8d63a4c517019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:00.608207 12301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.595480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:42903 (local address 127.0.0.1:58668)
0812 00:02:00.596967 (+ 1487us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:00.596976 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:00.597023 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:00.597273 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:00.597274 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:00.597276 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:00.597325 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:00.597327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.598978 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.598980 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:00.600435 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:00.600440 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.601841 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.601842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:00.602078 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.602111 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 00:02:00.602203 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 00:02:00.602275 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1443,"mutex_wait_us":45,"thread_start_us":113,"threads_started":1}
I20260812 00:02:00.608958 12300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.595641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:38701 (local address 127.0.0.1:46052)
0812 00:02:00.602514 (+ 6873us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:00.602526 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:00.602573 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:00.603791 (+ 1218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:00.603792 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:00.603794 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:00.603833 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:00.603834 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.605442 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.605444 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:00.606489 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:00.606493 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.608696 (+ 2203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.608698 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:00.608766 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.608771 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:02:00.608826 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 00:02:00.608872 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6861,"thread_start_us":119,"threads_started":1}
I20260812 00:02:00.609035 12305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.595937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46052 (local address 127.25.103.67:38701)
0812 00:02:00.596599 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:00.596603 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:00.602772 (+ 6169us) server_negotiation.cc:407] Connection header received
0812 00:02:00.602833 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:00.602836 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:00.602855 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:00.603686 (+ 831us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:00.603912 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.605329 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.606656 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.607912 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.607988 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.608102 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:00.608854 (+ 752us) server_negotiation.cc:299] Negotiation successful
0812 00:02:00.608919 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":95,"threads_started":1}
I20260812 00:02:00.609297 12303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.595910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58668 (local address 127.25.103.65:42903)
0812 00:02:00.596198 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:00.596203 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:00.597077 (+ 874us) server_negotiation.cc:407] Connection header received
0812 00:02:00.597117 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:00.597119 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:00.597136 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:00.597204 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:00.597400 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.598869 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.600852 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.601659 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.601730 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.601799 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:00.602360 (+ 561us) server_negotiation.cc:299] Negotiation successful
0812 00:02:00.602409 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":83,"threads_started":1}
I20260812 00:02:00.610097 11713 tablet_service.cc:1467] Processing CreateTablet for tablet a8fe28c8cc5e4065b5d8d63a4c517019 (DEFAULT_TABLE table=test-table [id=bbf293df08854914846187460057079a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:00.610512 11713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8fe28c8cc5e4065b5d8d63a4c517019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:00.614831 12312 tablet_bootstrap.cc:492] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051: Bootstrap starting.
I20260812 00:02:00.614810 12170 tablet_service.cc:1467] Processing CreateTablet for tablet a8fe28c8cc5e4065b5d8d63a4c517019 (DEFAULT_TABLE table=test-table [id=bbf293df08854914846187460057079a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:00.615229 12170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8fe28c8cc5e4065b5d8d63a4c517019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:00.615947 12312 tablet_bootstrap.cc:654] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:00.616417 12312 log.cc:824] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:00.617306 12312 tablet_bootstrap.cc:492] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051: No bootstrap required, opened a new log
I20260812 00:02:00.617368 12312 ts_tablet_manager.cc:1397] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:02:00.620546 12312 raft_consensus.cc:348] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2ad6343e7f74bab8331738dbfe7c051" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 42903 } } peers { permanent_uuid: "055ab9ab5252483e9ecd154727076ae5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39751 } } peers { permanent_uuid: "d03a7a8648eb4c2d8f3aa4a3486df202" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38701 } }
I20260812 00:02:00.620733 12312 raft_consensus.cc:374] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:00.620767 12312 raft_consensus.cc:729] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ad6343e7f74bab8331738dbfe7c051, State: Initialized, Role: FOLLOWER
I20260812 00:02:00.621460 12312 consensus_queue.cc:260] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2ad6343e7f74bab8331738dbfe7c051" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 42903 } } peers { permanent_uuid: "055ab9ab5252483e9ecd154727076ae5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39751 } } peers { permanent_uuid: "d03a7a8648eb4c2d8f3aa4a3486df202" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38701 } }
I20260812 00:02:00.621800 12312 ts_tablet_manager.cc:1428] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260812 00:02:00.621934 11839 heartbeater.cc:503] Master 127.25.103.126:45341 was elected leader, sending a full tablet report...
I20260812 00:02:00.622243 12310 tablet_bootstrap.cc:492] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5: Bootstrap starting.
I20260812 00:02:00.623677 12310 tablet_bootstrap.cc:654] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:00.624190 12310 log.cc:824] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:00.624730 12316 tablet_bootstrap.cc:492] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202: Bootstrap starting.
I20260812 00:02:00.625283 12310 tablet_bootstrap.cc:492] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5: No bootstrap required, opened a new log
I20260812 00:02:00.625420 12310 ts_tablet_manager.cc:1397] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:02:00.626127 12316 tablet_bootstrap.cc:654] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:00.626636 12316 log.cc:824] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:00.628486 12310 raft_consensus.cc:348] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2ad6343e7f74bab8331738dbfe7c051" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 42903 } } peers { permanent_uuid: "055ab9ab5252483e9ecd154727076ae5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39751 } } peers { permanent_uuid: "d03a7a8648eb4c2d8f3aa4a3486df202" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38701 } }
I20260812 00:02:00.628749 12316 tablet_bootstrap.cc:492] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202: No bootstrap required, opened a new log
I20260812 00:02:00.628738 12310 raft_consensus.cc:374] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:00.628831 12316 ts_tablet_manager.cc:1397] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260812 00:02:00.628844 12310 raft_consensus.cc:729] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 055ab9ab5252483e9ecd154727076ae5, State: Initialized, Role: FOLLOWER
I20260812 00:02:00.629128 12310 consensus_queue.cc:260] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2ad6343e7f74bab8331738dbfe7c051" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 42903 } } peers { permanent_uuid: "055ab9ab5252483e9ecd154727076ae5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39751 } } peers { permanent_uuid: "d03a7a8648eb4c2d8f3aa4a3486df202" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38701 } }
I20260812 00:02:00.629522 12310 ts_tablet_manager.cc:1428] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260812 00:02:00.629693 12053 heartbeater.cc:503] Master 127.25.103.126:45341 was elected leader, sending a full tablet report...
I20260812 00:02:00.631263 12316 raft_consensus.cc:348] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2ad6343e7f74bab8331738dbfe7c051" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 42903 } } peers { permanent_uuid: "055ab9ab5252483e9ecd154727076ae5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39751 } } peers { permanent_uuid: "d03a7a8648eb4c2d8f3aa4a3486df202" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38701 } }
I20260812 00:02:00.631421 12316 raft_consensus.cc:374] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:00.631458 12316 raft_consensus.cc:729] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03a7a8648eb4c2d8f3aa4a3486df202, State: Initialized, Role: FOLLOWER
I20260812 00:02:00.631608 12316 consensus_queue.cc:260] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2ad6343e7f74bab8331738dbfe7c051" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 42903 } } peers { permanent_uuid: "055ab9ab5252483e9ecd154727076ae5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39751 } } peers { permanent_uuid: "d03a7a8648eb4c2d8f3aa4a3486df202" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38701 } }
I20260812 00:02:00.631911 12316 ts_tablet_manager.cc:1428] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:02:00.632040 12280 heartbeater.cc:503] Master 127.25.103.126:45341 was elected leader, sending a full tablet report...
W20260812 00:02:00.710898 12054 tablet.cc:2369] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:02:00.753651 12319 raft_consensus.cc:482] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:02:00.753819 12319 raft_consensus.cc:504] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2ad6343e7f74bab8331738dbfe7c051" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 42903 } } peers { permanent_uuid: "055ab9ab5252483e9ecd154727076ae5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39751 } } peers { permanent_uuid: "d03a7a8648eb4c2d8f3aa4a3486df202" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38701 } }
I20260812 00:02:00.754609 12319 leader_election.cc:288] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 055ab9ab5252483e9ecd154727076ae5 (127.25.103.66:39751), d03a7a8648eb4c2d8f3aa4a3486df202 (127.25.103.67:38701)
I20260812 00:02:00.762413 12308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.755183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:51133 (local address 127.25.103.66:39751)
0812 00:02:00.755235 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:00.755237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:00.755962 (+ 725us) server_negotiation.cc:407] Connection header received
0812 00:02:00.756084 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:00.756086 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:00.756101 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:00.756156 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:00.756596 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.757310 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.759025 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.759613 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.759672 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.759684 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:00.762248 (+ 2564us) server_negotiation.cc:299] Negotiation successful
0812 00:02:00.762312 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:02:00.763000 12328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.754901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:39751 (local address 127.25.103.65:51133)
0812 00:02:00.755877 (+ 976us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:00.755890 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:00.755998 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:00.756258 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:00.756259 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:00.756298 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:00.756465 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:00.756468 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.757448 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.757449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:00.758902 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:00.758906 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.762047 (+ 3141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.762048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:00.762139 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.762145 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:02:00.762828 (+ 683us) client_negotiation.cc:240] Negotiation successful
0812 00:02:00.762889 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":946,"thread_start_us":140,"threads_started":1}
Aug 12 00:02:00 dist-test-slave-vpvm krb5kdc[10664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492920, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
I20260812 00:02:00.763700 11987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8fe28c8cc5e4065b5d8d63a4c517019" candidate_uuid: "f2ad6343e7f74bab8331738dbfe7c051" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "055ab9ab5252483e9ecd154727076ae5" is_pre_election: true
I20260812 00:02:00.763906 11987 raft_consensus.cc:2454] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ad6343e7f74bab8331738dbfe7c051 in term 0.
I20260812 00:02:00.764225 11632 leader_election.cc:302] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 055ab9ab5252483e9ecd154727076ae5, f2ad6343e7f74bab8331738dbfe7c051; no voters:
I20260812 00:02:00.764406 12319 raft_consensus.cc:2781] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:02:00.764468 12319 raft_consensus.cc:482] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:02:00.764495 12319 raft_consensus.cc:3037] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:00.765782 12319 raft_consensus.cc:504] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2ad6343e7f74bab8331738dbfe7c051" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 42903 } } peers { permanent_uuid: "055ab9ab5252483e9ecd154727076ae5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39751 } } peers { permanent_uuid: "d03a7a8648eb4c2d8f3aa4a3486df202" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38701 } }
I20260812 00:02:00.765969 12319 leader_election.cc:288] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [CANDIDATE]: Term 1 election: Requested vote from peers 055ab9ab5252483e9ecd154727076ae5 (127.25.103.66:39751), d03a7a8648eb4c2d8f3aa4a3486df202 (127.25.103.67:38701)
I20260812 00:02:00.766515 11987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8fe28c8cc5e4065b5d8d63a4c517019" candidate_uuid: "f2ad6343e7f74bab8331738dbfe7c051" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "055ab9ab5252483e9ecd154727076ae5"
I20260812 00:02:00.766621 11987 raft_consensus.cc:3037] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:00.767905 11987 raft_consensus.cc:2454] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ad6343e7f74bab8331738dbfe7c051 in term 1.
I20260812 00:02:00.768288 11632 leader_election.cc:302] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 055ab9ab5252483e9ecd154727076ae5, f2ad6343e7f74bab8331738dbfe7c051; no voters:
I20260812 00:02:00.768458 12319 raft_consensus.cc:2781] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:00.768661 12319 raft_consensus.cc:686] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [term 1 LEADER]: Becoming Leader. State: Replica: f2ad6343e7f74bab8331738dbfe7c051, State: Running, Role: LEADER
I20260812 00:02:00.768771 12319 consensus_queue.cc:237] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2ad6343e7f74bab8331738dbfe7c051" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 42903 } } peers { permanent_uuid: "055ab9ab5252483e9ecd154727076ae5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39751 } } peers { permanent_uuid: "d03a7a8648eb4c2d8f3aa4a3486df202" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38701 } }
I20260812 00:02:00.769805 11460 catalog_manager.cc:5495] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2ad6343e7f74bab8331738dbfe7c051 (127.25.103.65). New cstate: current_term: 1 leader_uuid: "f2ad6343e7f74bab8331738dbfe7c051" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2ad6343e7f74bab8331738dbfe7c051" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 42903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "055ab9ab5252483e9ecd154727076ae5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03a7a8648eb4c2d8f3aa4a3486df202" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38701 } health_report { overall_health: UNKNOWN } } }
I20260812 00:02:00.772279 12305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.755650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:57947 (local address 127.25.103.67:38701)
0812 00:02:00.755698 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:00.755700 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:00.759716 (+ 4016us) server_negotiation.cc:407] Connection header received
0812 00:02:00.759757 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:00.759758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:00.759771 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:00.759829 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:00.760153 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.760861 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.771138 (+ 10277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.771773 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.771842 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.771853 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:00.772144 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 00:02:00.772199 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:02:00.772806 12332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.755393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:38701 (local address 127.25.103.65:57947)
0812 00:02:00.759331 (+ 3938us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:00.759345 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:00.759420 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:00.759890 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:00.759892 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:00.759894 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:00.760047 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:00.760049 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.761035 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.761036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:00.770703 (+ 9667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:00.770709 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.771933 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.771934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:00.772037 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.772042 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:02:00.772593 (+ 551us) client_negotiation.cc:240] Negotiation successful
0812 00:02:00.772657 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3907,"thread_start_us":129,"threads_started":1}
I20260812 00:02:00.773460 12202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8fe28c8cc5e4065b5d8d63a4c517019" candidate_uuid: "f2ad6343e7f74bab8331738dbfe7c051" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03a7a8648eb4c2d8f3aa4a3486df202" is_pre_election: true
I20260812 00:02:00.773648 12202 raft_consensus.cc:2454] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ad6343e7f74bab8331738dbfe7c051 in term 0.
I20260812 00:02:00.773808 12201 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8fe28c8cc5e4065b5d8d63a4c517019" candidate_uuid: "f2ad6343e7f74bab8331738dbfe7c051" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03a7a8648eb4c2d8f3aa4a3486df202"
I20260812 00:02:00.773893 12201 raft_consensus.cc:3037] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:00.775218 12201 raft_consensus.cc:2454] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ad6343e7f74bab8331738dbfe7c051 in term 1.
I20260812 00:02:00.791360 12303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.787863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58670 (local address 127.25.103.65:42903)
0812 00:02:00.787923 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:00.787925 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:00.787937 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:02:00.788044 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:00.788045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:00.788070 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:00.788141 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:02:00.788346 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.789063 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.790148 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.790443 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.790499 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.790693 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:02:00.790838 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:02:00.790922 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:00.791186 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 00:02:00.791213 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260812 00:02:00.792903 12282 tablet.cc:2369] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:02:00.794150 11987 raft_consensus.cc:1261] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5 [term 1 FOLLOWER]: Refusing update from remote peer f2ad6343e7f74bab8331738dbfe7c051: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:00.794629 12319 consensus_queue.cc:1035] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [LEADER]: Connected to new peer: Peer: permanent_uuid: "055ab9ab5252483e9ecd154727076ae5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:00.794975 12201 raft_consensus.cc:1261] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202 [term 1 FOLLOWER]: Refusing update from remote peer f2ad6343e7f74bab8331738dbfe7c051: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:00.795486 12319 consensus_queue.cc:1035] T a8fe28c8cc5e4065b5d8d63a4c517019 P f2ad6343e7f74bab8331738dbfe7c051 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03a7a8648eb4c2d8f3aa4a3486df202" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:00.800241 12337 mvcc.cc:205] Tried to move back new op lower bound from 7317475003568570368 to 7317475003469697024. Current Snapshot: MvccSnapshot[applied={T|T < 7317475003568570368}]
I20260812 00:02:00.803406 12338 mvcc.cc:205] Tried to move back new op lower bound from 7317475003568570368 to 7317475003469697024. Current Snapshot: MvccSnapshot[applied={T|T < 7317475003568570368}]
I20260812 00:02:00.803954 12340 mvcc.cc:205] Tried to move back new op lower bound from 7317475003568570368 to 7317475003469697024. Current Snapshot: MvccSnapshot[applied={T|T < 7317475003568570368}]
I20260812 00:02:00.810626 11461 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32792:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:00.810774 11461 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32792:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:00.811728 11461 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d10fc8edf84c4fbf8c20cbd8e0711fcf: Sending DeleteTablet for 3 replicas of tablet a8fe28c8cc5e4065b5d8d63a4c517019
I20260812 00:02:00.812628 11945 tablet_service.cc:1514] Processing DeleteTablet for tablet a8fe28c8cc5e4065b5d8d63a4c517019 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:00 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:48200
I20260812 00:02:00.812744 12170 tablet_service.cc:1514] Processing DeleteTablet for tablet a8fe28c8cc5e4065b5d8d63a4c517019 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:00 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:46052
I20260812 00:02:00.813033 11713 tablet_service.cc:1514] Processing DeleteTablet for tablet a8fe28c8cc5e4065b5d8d63a4c517019 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:00 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:58668
I20260812 00:02:00.813714 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 11610
I20260812 00:02:00.817181 12354 tablet_replica.cc:330] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5: stopping tablet replica
I20260812 00:02:00.817353 12354 raft_consensus.cc:2229] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:00.817453 12354 raft_consensus.cc:2258] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:00.826107 12356 tablet_replica.cc:330] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202: stopping tablet replica
I20260812 00:02:00.826308 12356 raft_consensus.cc:2229] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:00.826402 12356 raft_consensus.cc:2258] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:00.831571 12354 ts_tablet_manager.cc:1905] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:00.834473 12354 ts_tablet_manager.cc:1918] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:00.834692 12354 log.cc:1196] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/a8fe28c8cc5e4065b5d8d63a4c517019
I20260812 00:02:00.835105 12354 ts_tablet_manager.cc:1939] T a8fe28c8cc5e4065b5d8d63a4c517019 P 055ab9ab5252483e9ecd154727076ae5: Deleting consensus metadata
I20260812 00:02:00.836169 11440 catalog_manager.cc:4841] TS 055ab9ab5252483e9ecd154727076ae5 (127.25.103.66:39751): tablet a8fe28c8cc5e4065b5d8d63a4c517019 (table test-table [id=bbf293df08854914846187460057079a]) successfully deleted
I20260812 00:02:00.838833 12356 ts_tablet_manager.cc:1905] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:00.841936 12356 ts_tablet_manager.cc:1918] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:00.842186 12356 log.cc:1196] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/a8fe28c8cc5e4065b5d8d63a4c517019
I20260812 00:02:00.842840 12356 ts_tablet_manager.cc:1939] T a8fe28c8cc5e4065b5d8d63a4c517019 P d03a7a8648eb4c2d8f3aa4a3486df202: Deleting consensus metadata
I20260812 00:02:00.843538 11441 catalog_manager.cc:4841] TS d03a7a8648eb4c2d8f3aa4a3486df202 (127.25.103.67:38701): tablet a8fe28c8cc5e4065b5d8d63a4c517019 (table test-table [id=bbf293df08854914846187460057079a]) successfully deleted
W20260812 00:02:00.846115 11435 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.103.65:42903 (error 108)
I20260812 00:02:00.846870 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 11848
I20260812 00:02:00.857409 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 12062
I20260812 00:02:00.862780 12300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.862570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:42903 (local address 127.0.0.1:58686)
0812 00:02:00.862638 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:00.862723 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:42903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 00:02:00.862977 11435 catalog_manager.cc:4584] TS f2ad6343e7f74bab8331738dbfe7c051 (127.25.103.65:42903): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a8fe28c8cc5e4065b5d8d63a4c517019: Network error: Client connection negotiation failed: client connection to 127.25.103.65:42903: connect: Connection refused (error 111)
I20260812 00:02:00.865200 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 11406
I20260812 00:02:00.890863 26013 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 00:02:01.238833 26013 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 00:02:01.238971 26013 mini_ranger.cc:66] Stopping Ranger...
I20260812 00:02:01.587924 26013 mini_ranger.cc:68] Stopped Ranger
2026-08-12 00:02:01.588 UTC [10720] LOG: received smart shutdown request
2026-08-12 00:02:01.592 UTC [10720] LOG: background worker "logical replication launcher" (PID 10732) exited with exit code 1
2026-08-12 00:02:01.592 UTC [10726] LOG: shutting down
2026-08-12 00:02:01.767 UTC [10720] LOG: database system is shut down
2026-08-12T00:02:01Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (56726 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:02:01 dist-test-slave-vpvm krb5kdc[12379](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:02:01 dist-test-slave-vpvm krb5kdc[12379](info): set up 2 sockets
Aug 12 00:02:01 dist-test-slave-vpvm krb5kdc[12379](info): commencing operation
krb5kdc: starting...
W20260812 00:02:03.125538 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:02:03 dist-test-slave-vpvm krb5kdc[12379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492923, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:02:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:02:03Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.25.103.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.25.103.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.25.103.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/rangeradmin_127.25.103.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.25.103.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/rangeradmin_127.25.103.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.25.103.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.25.103.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.25.103.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/rangerlookup_127.25.103.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.25.103.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/rangerlookup_127.25.103.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.103.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.25.103.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.103.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/HTTP_127.25.103.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.103.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/HTTP_127.25.103.84@KRBTEST.COM.keytab.
I20260812 00:02:03.319175 26013 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskdkQn2d/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/postgres -l logfile start
2026-08-12 00:02:06.181 UTC [12427] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 00:02:06.181 UTC [12427] LOG: listening on IPv4 address "127.25.103.84", port 38557
2026-08-12 00:02:06.185 UTC [12427] LOG: listening on Unix socket "/tmp/.s.PGSQL.38557"
2026-08-12 00:02:06.208 UTC [12430] LOG: database system was shut down at 2026-08-12 00:02:04 UTC
2026-08-12 00:02:06.213 UTC [12427] LOG: database system is ready to accept connections
I20260812 00:02:07.322851 26013 mini_postgres.cc:96] Postgres bound to 38557
2026-08-12 00:02:07.330 UTC [12444] FATAL: database "slave" does not exist
127.25.103.84:38557 - accepting connections
I20260812 00:02:07.331751 26013 mini_ranger.cc:161] Starting Ranger...
I20260812 00:02:07.348191 26013 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 00:02:07.875783 26013 mini_ranger.cc:87] Created ranger Postgres database
I20260812 00:02:07.875876 26013 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-admin
2026-08-12 00:02:08,178 [I] DB FLAVOR :POSTGRES
2026-08-12 00:02:08,178 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:02:08,178 [I] Checking connection..
2026-08-12 00:02:08,178 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 00:02:08,481 [I] Checking connection passed.
2026-08-12 00:02:08,482 [I] --------- Verifying version history table ---------
2026-08-12 00:02:08,482 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:02:08,787 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:02:08,788 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:02:09,081 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:02:09,081 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 00:02:09,081 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 00:02:09.384 UTC [12548] WARNING: there is no transaction in progress
2026-08-12 00:02:09,394 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 00:02:09,395 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:02:09,703 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 00:02:09,703 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:02:09,704 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 00:02:10,000 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 00:02:10,308 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-vpvm.c.gcp-upstream.internal','N') ;"
2026-08-12 00:02:10,603 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:02:10,888 [I] Table x_portal_user does not exist in database ranger
2026-08-12 00:02:10,888 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:02:11,178 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 00:02:11,178 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:02:11,463 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:02:11,794 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 00:02:11,794 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 00:02:12.941 UTC [12717] WARNING: there is no transaction in progress
2026-08-12 00:02:12.960 UTC [12717] WARNING: there is no transaction in progress
2026-08-12 00:02:12.980 UTC [12717] WARNING: there is no transaction in progress
2026-08-12 00:02:13.000 UTC [12717] WARNING: there is no transaction in progress
2026-08-12 00:02:13.020 UTC [12717] WARNING: there is no transaction in progress
2026-08-12 00:02:13.041 UTC [12717] WARNING: there is no transaction in progress
2026-08-12 00:02:13.107 UTC [12717] WARNING: there is no transaction in progress
2026-08-12 00:02:13.116 UTC [12717] WARNING: there is no transaction in progress
2026-08-12 00:02:13.134 UTC [12717] WARNING: there is no transaction in progress
2026-08-12 00:02:13.146 UTC [12717] WARNING: there is no transaction in progress
2026-08-12 00:02:13.159 UTC [12717] WARNING: there is no transaction in progress
2026-08-12 00:02:13.176 UTC [12717] WARNING: there is no transaction in progress
2026-08-12 00:02:13.187 UTC [12717] WARNING: there is no transaction in progress
2026-08-12 00:02:13.196 UTC [12717] WARNING: there is no transaction in progress
2026-08-12 00:02:13.205 UTC [12717] WARNING: there is no transaction in progress
2026-08-12 00:02:13.215 UTC [12717] WARNING: there is no transaction in progress
2026-08-12 00:02:14,102 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 00:02:14,103 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 00:02:14,403 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 00:02:14,403 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:02:14,705 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 00:02:14,706 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:02:14,995 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 00:02:14,995 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:02:15,300 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:02:15,581 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-vpvm.c.gcp-upstream.internal';"
2026-08-12 00:02:15,864 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 00:02:15,865 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 00:02:16,137 [I] DB_PATCHES have already been applied
I20260812 00:02:16.146121 26013 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-admin:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskdkQn2d/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 00:02:16.146231 26013 mini_ranger.cc:193] Using host: 127.25.103.84
I20260812 00:02:16.151597 26013 mini_ranger.cc:227] Ranger admin URL: http://127.25.103.84:56873
Aug 12, 2026 12:02:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:02:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:02:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 12:02:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 12:02:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 12:02:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 12:02:17 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 00:02:17.500929 26013 mini_ranger.cc:160] Time spent starting Ranger: real 10.169s user 0.001s sys 0.013s
Aug 12, 2026 12:02:40 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 12:02:40 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 12:02:40 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 12:02:40 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 12:02:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 12:02:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 12:02:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 12:02:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 12:02:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 12:02:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 12:02:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 12:02:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 12:02:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 12:02:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 12:02:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 12:02:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 12:02:40 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 12:02:41 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 00:02:42.683743 26013 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.25.103.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.25.103.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.25.103.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/rangerkms_127.25.103.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.25.103.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/rangerkms_127.25.103.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.103.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.25.103.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.103.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/HTTP_127.25.103.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.103.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/HTTP_127.25.103.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 00:02:42 dist-test-slave-vpvm krb5kdc[12379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492962, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 00:02:42.794386 26013 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 00:02:42.810669 26013 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 00:02:43.794090 26013 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 00:02:43.794195 26013 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-kms
I20260812 00:02:43.794214 26013 mini_ranger_kms.cc:227] Using postgres at 127.25.103.84:38557
2026-08-12 00:02:43,998 [I] DB FLAVOR :POSTGRES
2026-08-12 00:02:43,999 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:02:43,999 [I] Checking connection
2026-08-12 00:02:43,999 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 00:02:44,297 [I] connection success
2026-08-12 00:02:44,297 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 00:02:44,297 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 00:02:44,297 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 00:02:44,589 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 00:02:44,589 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:02:44,590 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 00:02:44,590 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.103.84:38557/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 00:02:44,910 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 00:02:45.504268 26013 mini_ranger_kms.cc:310] Created kms service
I20260812 00:02:45.711853 26013 mini_ranger_kms.cc:326] Created kudu user
I20260812 00:02:45.770610 26013 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 00:02:45 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492962, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
I20260812 00:02:46.273738 26013 mini_ranger_kms.cc:384] Added ranger policy
I20260812 00:02:46.273872 26013 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-kms:/tmp/dist-test-taskdkQn2d/build/release/bin/postgresql.jar:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskdkQn2d/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 00:02:46.273891 26013 mini_ranger_kms.cc:240] Using host: 127.25.103.84
I20260812 00:02:46.278275 26013 mini_ranger_kms.cc:276] Ranger KMS PID: 13042
I20260812 00:02:46.278375 26013 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.25.103.84:47225
Aug 12, 2026 12:02:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:02:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:02:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 12:02:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 12:02:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 12:02:47 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 00:02:48 dist-test-slave-vpvm krb5kdc[12379](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786492968, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.103.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:48.963479 26013 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.169s user 0.000s sys 0.188s
I20260812 00:02:48.963582 26013 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 00:02:48.963629 26013 mini_ranger_kms.cc:401] 127.25.103.84:47225/kms/v1/keys
Aug 12 00:02:49 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492968, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.103.84@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
Aug 12 00:02:49 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492968, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.103.84@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
Aug 12 00:02:52 dist-test-slave-vpvm krb5kdc[12379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:02:52.186621 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:40599
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:44441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:40599
--ranger_config_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.103.84:47225/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:52.315011 13130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:52.315335 13130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:52.315369 13130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:52.317306 13130 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:52.317397 13130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:52.317415 13130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:52.317431 13130 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:52.317446 13130 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:52.320017 13130 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:44441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/wal
--ranger_kms_url=127.25.103.84:47225/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:40599
--ranger_config_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:40599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:02:52.320345 13130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:52.320655 13130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:52.327484 13140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:52.327551 13136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:52.327836 13137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:52.327669 13130 server_base.cc:1034] running on GCE node
I20260812 00:02:52.328310 13130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:52.328904 13130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:52.330060 13130 hybrid_clock.cc:648] HybridClock initialized: now 1786492972330021 us; error 53 us; skew 500 ppm
Aug 12 00:02:52 dist-test-slave-vpvm krb5kdc[12379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492972, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:52.333009 13130 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:02:52.333547 13130 webserver.cc:460] Webserver started at http://127.25.103.126:33863/ using document root <none> and password file <none>
I20260812 00:02:52.333791 13130 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:52.333835 13130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:52.334004 13130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:02:52 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492972, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
I20260812 00:02:52.389642 13130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "e180734c72584b1f90cf28aea37ed761"
format_stamp: "Formatted at 2026-08-12 00:02:52 on dist-test-slave-vpvm"
server_key: "8d6f91a693022bcb2869653c42befd03"
server_key_iv: "b188b553cccfa7161ef62989b6b85a2b"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:52.390192 13130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "e180734c72584b1f90cf28aea37ed761"
format_stamp: "Formatted at 2026-08-12 00:02:52 on dist-test-slave-vpvm"
server_key: "8d6f91a693022bcb2869653c42befd03"
server_key_iv: "b188b553cccfa7161ef62989b6b85a2b"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:52.392109 13130 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260812 00:02:52.409641 13150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:52.409873 13130 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:02:52.410044 13130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "e180734c72584b1f90cf28aea37ed761"
format_stamp: "Formatted at 2026-08-12 00:02:52 on dist-test-slave-vpvm"
server_key: "8d6f91a693022bcb2869653c42befd03"
server_key_iv: "b188b553cccfa7161ef62989b6b85a2b"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:52.410145 13130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:52.440114 13130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:52.442976 13130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:52.443202 13130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:52.448216 13130 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:40599
I20260812 00:02:52.448235 13232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:40599 every 8 connection(s)
I20260812 00:02:52.448680 13130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:02:52.449411 13233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:52.451902 13233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761: Bootstrap starting.
I20260812 00:02:52.452502 13233 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:52.452756 13233 log.cc:824] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:52.453826 13233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761: No bootstrap required, opened a new log
I20260812 00:02:52.456372 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 13130
I20260812 00:02:52.456506 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:02:52.456719 26013 external_mini_cluster.cc:1428] Setting key a745bb8cb92801e102434f166894d729
I20260812 00:02:52.456753 13233 raft_consensus.cc:348] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e180734c72584b1f90cf28aea37ed761" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 40599 } }
I20260812 00:02:52.457029 13233 raft_consensus.cc:374] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:52.457077 13233 raft_consensus.cc:729] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e180734c72584b1f90cf28aea37ed761, State: Initialized, Role: FOLLOWER
I20260812 00:02:52.457259 13233 consensus_queue.cc:260] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e180734c72584b1f90cf28aea37ed761" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 40599 } }
I20260812 00:02:52.457365 13233 raft_consensus.cc:388] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:02:52.457442 13233 raft_consensus.cc:482] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:02:52.457567 13233 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:52.458453 13233 raft_consensus.cc:504] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e180734c72584b1f90cf28aea37ed761" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 40599 } }
I20260812 00:02:52.458562 13233 leader_election.cc:302] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e180734c72584b1f90cf28aea37ed761; no voters:
I20260812 00:02:52.458755 13233 leader_election.cc:288] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:02:52.458819 13243 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:52.459066 13243 raft_consensus.cc:686] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [term 1 LEADER]: Becoming Leader. State: Replica: e180734c72584b1f90cf28aea37ed761, State: Running, Role: LEADER
I20260812 00:02:52.459079 13233 sys_catalog.cc:564] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:52.459306 13243 consensus_queue.cc:237] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e180734c72584b1f90cf28aea37ed761" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 40599 } }
I20260812 00:02:52.461025 13244 sys_catalog.cc:455] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e180734c72584b1f90cf28aea37ed761" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e180734c72584b1f90cf28aea37ed761" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 40599 } } }
I20260812 00:02:52.461130 13244 sys_catalog.cc:458] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:52.461104 13233 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 00:02:52.461747 13266 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:02:52.461691 13245 sys_catalog.cc:455] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e180734c72584b1f90cf28aea37ed761. Latest consensus state: current_term: 1 leader_uuid: "e180734c72584b1f90cf28aea37ed761" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e180734c72584b1f90cf28aea37ed761" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 40599 } } }
I20260812 00:02:52.464032 13245 sys_catalog.cc:458] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:52.465570 13266 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 00:02:52 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:02:52.468932 13266 catalog_manager.cc:1347] Generated new cluster ID: 407146da2f614c14b94720a25485083e
I20260812 00:02:52.469012 13266 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:02:52.472169 13242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:52.457554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48318 (local address 127.25.103.126:40599)
0812 00:02:52.457802 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:52.457813 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:52.457848 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:02:52.458013 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:52.458021 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:52.458090 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:52.458246 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:52.459131 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:52.460571 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:52.461667 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:52.465032 (+ 3365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:52.465252 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:52.468534 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:52.468540 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:52.468540 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:52.468558 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:52.470475 (+ 1917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:52.470889 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:52.470892 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:52.470893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:52.470986 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:52.471205 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:52.471206 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:52.471207 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:52.471497 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:52.471653 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:52.471779 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 00:02:52.471929 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":134,"threads_started":1}
I20260812 00:02:52.483260 13266 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:02:52.484139 13266 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:52.494863 13266 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761: Generated new TSK 0
I20260812 00:02:52.495078 13266 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
I20260812 00:02:53.291473 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.103.84:47225/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:40599
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:44441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:53.389707 13310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:53.389981 13310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:53.390022 13310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:53.391388 13310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:53.391611 13310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:53.391707 13310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:02:53.393847 13310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:44441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.25.103.84:47225/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:40599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:02:53.394198 13310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:53.394451 13310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:53.400732 13316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:53.400897 13310 server_base.cc:1034] running on GCE node
W20260812 00:02:53.400759 13323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:53.400861 13319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:53.401594 13310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:53.402011 13310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:53.403213 13310 hybrid_clock.cc:648] HybridClock initialized: now 1786492973403193 us; error 56 us; skew 500 ppm
Aug 12 00:02:53 dist-test-slave-vpvm krb5kdc[12379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492973, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:53.406745 13310 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:02:53.407363 13310 webserver.cc:460] Webserver started at http://127.25.103.65:40201/ using document root <none> and password file <none>
I20260812 00:02:53.407681 13310 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:53.407748 13310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:53.407881 13310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:02:53 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492973, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
I20260812 00:02:53.425573 13310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "54a17944ad474bbab5c160d53ff98c2c"
format_stamp: "Formatted at 2026-08-12 00:02:53 on dist-test-slave-vpvm"
server_key: "0c67886455cadc5a1ca2e1c5c9822e51"
server_key_iv: "b8c3d86693d7c3aa6d2bb88c712e222d"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:53.426386 13310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "54a17944ad474bbab5c160d53ff98c2c"
format_stamp: "Formatted at 2026-08-12 00:02:53 on dist-test-slave-vpvm"
server_key: "0c67886455cadc5a1ca2e1c5c9822e51"
server_key_iv: "b8c3d86693d7c3aa6d2bb88c712e222d"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:53.429236 13310 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20260812 00:02:53.445253 13334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:53.445499 13310 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:02:53.445605 13310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "54a17944ad474bbab5c160d53ff98c2c"
format_stamp: "Formatted at 2026-08-12 00:02:53 on dist-test-slave-vpvm"
server_key: "0c67886455cadc5a1ca2e1c5c9822e51"
server_key_iv: "b8c3d86693d7c3aa6d2bb88c712e222d"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:53.445704 13310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:53.463538 13310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:53.466046 13310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:53.466272 13310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:53.466593 13310 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:53.467025 13310 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:53.467097 13310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:53.467147 13310 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:53.467181 13310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:53.475517 13310 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:37151
I20260812 00:02:53.475700 13527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:37151 every 8 connection(s)
I20260812 00:02:53.476059 13310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:02:53.482019 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 13310
I20260812 00:02:53.482143 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:02:53.482407 26013 external_mini_cluster.cc:1428] Setting key 264da24e7fe0f6703688cbefe3a8047b
Aug 12 00:02:53 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492973, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:02:53.492952 13531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:53.477023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:60369 (local address 127.25.103.126:40599)
0812 00:02:53.477207 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:53.477209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:53.477427 (+ 218us) server_negotiation.cc:407] Connection header received
0812 00:02:53.478193 (+ 766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:53.478194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:53.478210 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:53.478258 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:53.482739 (+ 4481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:53.483495 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:53.485088 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:53.485435 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:53.485529 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:53.488904 (+ 3375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:53.488906 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:53.488906 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:53.488917 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:53.490952 (+ 2035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:53.491653 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:53.491654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:53.491655 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:53.491729 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:53.492013 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:53.492014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:53.492014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:53.492166 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:53.492220 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:53.492728 (+ 508us) server_negotiation.cc:299] Negotiation successful
0812 00:02:53.492841 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":115,"threads_started":1}
I20260812 00:02:53.493841 13530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:53.476986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:40599 (local address 127.25.103.65:60369)
0812 00:02:53.477288 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:53.477337 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:53.478064 (+ 727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:53.478474 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:53.478479 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:53.478757 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:53.482537 (+ 3780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:53.482552 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:53.483657 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:53.483659 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:53.484951 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:53.484957 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:53.485642 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:53.485644 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:53.485821 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:53.486552 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:53.486564 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:53.488732 (+ 2168us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:53.491079 (+ 2347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:53.491091 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:53.491095 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:53.491549 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:53.491797 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:53.491797 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:53.491798 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:53.491941 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:53.492259 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:53.492266 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:53.492552 (+ 286us) client_negotiation.cc:769] Sending connection context
0812 00:02:53.493372 (+ 820us) client_negotiation.cc:240] Negotiation successful
0812 00:02:53.493587 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":101,"threads_started":1}
I20260812 00:02:53.494656 13528 heartbeater.cc:347] Connected to a master server at 127.25.103.126:40599
I20260812 00:02:53.494781 13528 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:53.495004 13528 heartbeater.cc:511] Master 127.25.103.126:40599 requested a full tablet report, sending...
I20260812 00:02:53.495674 13179 ts_manager.cc:194] Registered new tserver with Master: 54a17944ad474bbab5c160d53ff98c2c (127.25.103.65:37151)
I20260812 00:02:53.496702 13179 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:60369
WARNING: no policy specified for kudu/127.25.103.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
I20260812 00:02:53.525337 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.103.84:47225/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:40599
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:44441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:53.651260 13544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:53.651633 13544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:53.651695 13544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:53.653673 13544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:53.653759 13544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:53.653808 13544 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:02:53.656386 13544 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:44441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.25.103.84:47225/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:40599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:02:53.656721 13544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:53.657070 13544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:53.664460 13558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:53.664517 13556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:53.665074 13544 server_base.cc:1034] running on GCE node
W20260812 00:02:53.664719 13555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:53.665345 13544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:53.665688 13544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:53.666878 13544 hybrid_clock.cc:648] HybridClock initialized: now 1786492973666855 us; error 38 us; skew 500 ppm
Aug 12 00:02:53 dist-test-slave-vpvm krb5kdc[12379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492973, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:53.670662 13544 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:02:53.671296 13544 webserver.cc:460] Webserver started at http://127.25.103.66:34449/ using document root <none> and password file <none>
I20260812 00:02:53.671626 13544 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:53.671695 13544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:53.671892 13544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:02:53 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492973, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
I20260812 00:02:53.687841 13544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "0d163010d30a451aa4f8aa805f9fc6bd"
format_stamp: "Formatted at 2026-08-12 00:02:53 on dist-test-slave-vpvm"
server_key: "8108e2e5b69683955fd639154c6e629e"
server_key_iv: "8eb49e3bdb4661b353de2059874bb073"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:53.688490 13544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "0d163010d30a451aa4f8aa805f9fc6bd"
format_stamp: "Formatted at 2026-08-12 00:02:53 on dist-test-slave-vpvm"
server_key: "8108e2e5b69683955fd639154c6e629e"
server_key_iv: "8eb49e3bdb4661b353de2059874bb073"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:53.691962 13544 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:02:53.711894 13572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:53.712225 13544 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260812 00:02:53.712342 13544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "0d163010d30a451aa4f8aa805f9fc6bd"
format_stamp: "Formatted at 2026-08-12 00:02:53 on dist-test-slave-vpvm"
server_key: "8108e2e5b69683955fd639154c6e629e"
server_key_iv: "8eb49e3bdb4661b353de2059874bb073"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:53.712447 13544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 12 00:02:53 dist-test-slave-vpvm krb5kdc[12379](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786492973, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:53.746778 13544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:53.749428 13544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:53.749698 13544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:53.750074 13544 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:53.750623 13544 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:53.750717 13544 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:53.750790 13544 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:53.750850 13544 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:53.757930 13544 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:43503
I20260812 00:02:53.761674 13544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:02:53.760973 13770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:43503 every 8 connection(s)
I20260812 00:02:53.765029 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 13544
I20260812 00:02:53.765130 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:02:53.765318 26013 external_mini_cluster.cc:1428] Setting key ab22c8cf9cbca9bf75fc133f664448b4
Aug 12 00:02:53 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492973, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:02:53.774917 13531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:53.763161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:41013 (local address 127.25.103.126:40599)
0812 00:02:53.763277 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:53.763280 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:53.763507 (+ 227us) server_negotiation.cc:407] Connection header received
0812 00:02:53.764213 (+ 706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:53.764215 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:53.764235 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:53.764267 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:53.765301 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:53.766182 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:53.767735 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:53.768039 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:53.768088 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:53.771021 (+ 2933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:53.771023 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:53.771023 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:53.771033 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:53.772755 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:53.773452 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:53.773454 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:53.773455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:53.773600 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:53.773996 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:53.773997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:53.773997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:53.774210 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:53.774263 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:53.774702 (+ 439us) server_negotiation.cc:299] Negotiation successful
0812 00:02:53.774811 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 00:02:53.775792 13775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:53.763149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:40599 (local address 127.25.103.66:41013)
0812 00:02:53.763352 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:53.763400 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:53.764075 (+ 675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:53.764469 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:53.764474 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:53.764769 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:53.765073 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:53.765080 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:53.766309 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:53.766310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:53.767622 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:53.767626 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:53.768208 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:53.768209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:53.768366 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:53.769022 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:53.769033 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:53.770886 (+ 1853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:53.772875 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:53.772884 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:53.772887 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:53.773333 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:53.773721 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:53.773722 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:53.773723 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:53.773881 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:53.774316 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:53.774323 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:53.774516 (+ 193us) client_negotiation.cc:769] Sending connection context
0812 00:02:53.775316 (+ 800us) client_negotiation.cc:240] Negotiation successful
0812 00:02:53.775520 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":109,"threads_started":1}
I20260812 00:02:53.776822 13773 heartbeater.cc:347] Connected to a master server at 127.25.103.126:40599
I20260812 00:02:53.777022 13773 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:53.777359 13773 heartbeater.cc:511] Master 127.25.103.126:40599 requested a full tablet report, sending...
I20260812 00:02:53.778152 13179 ts_manager.cc:194] Registered new tserver with Master: 0d163010d30a451aa4f8aa805f9fc6bd (127.25.103.66:43503)
I20260812 00:02:53.778752 13179 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:41013
WARNING: no policy specified for kudu/127.25.103.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
I20260812 00:02:53.825508 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.103.84:47225/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:40599
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:44441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:53.964512 13781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:53.964941 13781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:53.965034 13781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:53.967188 13781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:53.967348 13781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:53.967445 13781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:02:53.970203 13781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:44441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.25.103.84:47225/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:40599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:02:53.970767 13781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:53.971131 13781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:53.978513 13790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:53.978971 13788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:53.979212 13792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:53.980005 13781 server_base.cc:1034] running on GCE node
I20260812 00:02:53.980350 13781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:53.980670 13781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:53.981853 13781 hybrid_clock.cc:648] HybridClock initialized: now 1786492973981828 us; error 37 us; skew 500 ppm
Aug 12 00:02:53 dist-test-slave-vpvm krb5kdc[12379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492973, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:53.985544 13781 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:02:53.986166 13781 webserver.cc:460] Webserver started at http://127.25.103.67:45809/ using document root <none> and password file <none>
I20260812 00:02:53.986426 13781 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:53.986475 13781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:53.986624 13781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:02:53 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492973, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
I20260812 00:02:54.005705 13781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "900c5b87b4ce4fc186ad3097c4a03670"
format_stamp: "Formatted at 2026-08-12 00:02:53 on dist-test-slave-vpvm"
server_key: "03d754232dde53453616669ffd2e1a41"
server_key_iv: "30ddadadac0881d5e370e23176f71a07"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:54.006245 13781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "900c5b87b4ce4fc186ad3097c4a03670"
format_stamp: "Formatted at 2026-08-12 00:02:53 on dist-test-slave-vpvm"
server_key: "03d754232dde53453616669ffd2e1a41"
server_key_iv: "30ddadadac0881d5e370e23176f71a07"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:54.023665 13781 fs_manager.cc:691] Time spent creating directory manager: real 0.017s user 0.000s sys 0.002s
I20260812 00:02:54.039899 13802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:54.040174 13781 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 00:02:54.040273 13781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "900c5b87b4ce4fc186ad3097c4a03670"
format_stamp: "Formatted at 2026-08-12 00:02:53 on dist-test-slave-vpvm"
server_key: "03d754232dde53453616669ffd2e1a41"
server_key_iv: "30ddadadac0881d5e370e23176f71a07"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:54.040380 13781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:54.059491 13781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:54.063416 13781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:54.063748 13781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:54.064165 13781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:54.064719 13781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:54.064828 13781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:54.064930 13781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:54.065001 13781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:54.079228 13781 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:34247
I20260812 00:02:54.079861 13781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:02:54.080509 13989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:34247 every 8 connection(s)
I20260812 00:02:54.085716 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 13781
I20260812 00:02:54.085832 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:02:54.086077 26013 external_mini_cluster.cc:1428] Setting key 29fd7e0907f4796f1c3c4cb5d704306b
Aug 12 00:02:54 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492973, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:02:54.096155 13531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:54.081809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:57419 (local address 127.25.103.126:40599)
0812 00:02:54.081863 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:54.081878 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:54.082315 (+ 437us) server_negotiation.cc:407] Connection header received
0812 00:02:54.083164 (+ 849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:54.083166 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:54.083183 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:54.083221 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:54.084208 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:54.084965 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:54.088556 (+ 3591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:54.088863 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:54.088927 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:54.092212 (+ 3285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:54.092215 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:54.092215 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:54.092225 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:54.094189 (+ 1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:54.094844 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:54.094846 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:54.094846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:54.094940 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:54.095289 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:54.095290 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:54.095290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:54.095455 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:54.095515 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:54.095944 (+ 429us) server_negotiation.cc:299] Negotiation successful
0812 00:02:54.096053 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:02:54.097070 13993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:54.081466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:40599 (local address 127.25.103.67:57419)
0812 00:02:54.082169 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:54.082215 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:54.082990 (+ 775us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:54.083440 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:54.083445 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:54.083748 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:54.084077 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:54.084085 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:54.085107 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:54.085108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:54.088357 (+ 3249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:54.088363 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:54.089065 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:54.089066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:54.089238 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:54.090025 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:54.090037 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:54.092041 (+ 2004us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:54.094328 (+ 2287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:54.094339 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:54.094342 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:54.094727 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:54.095029 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:54.095029 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:54.095030 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:54.095193 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:54.095555 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:54.095562 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:54.095753 (+ 191us) client_negotiation.cc:769] Sending connection context
0812 00:02:54.096593 (+ 840us) client_negotiation.cc:240] Negotiation successful
0812 00:02:54.096803 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":114,"threads_started":1}
I20260812 00:02:54.098485 13990 heartbeater.cc:347] Connected to a master server at 127.25.103.126:40599
I20260812 00:02:54.098598 13990 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:54.098812 13990 heartbeater.cc:511] Master 127.25.103.126:40599 requested a full tablet report, sending...
I20260812 00:02:54.099337 13179 ts_manager.cc:194] Registered new tserver with Master: 900c5b87b4ce4fc186ad3097c4a03670 (127.25.103.67:34247)
I20260812 00:02:54.099826 13179 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:57419
I20260812 00:02:54.110055 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:02:54.110878 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 13310
I20260812 00:02:54.146970 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 13544
I20260812 00:02:54.171758 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 13781
I20260812 00:02:54.194939 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 13130
I20260812 00:02:54.223783 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:40599
--webserver_interface=127.25.103.126
--webserver_port=33863
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:44441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:40599
--ranger_config_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.103.84:47225/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.103.84:47225/kms with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:54.323894 13994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:54.324139 13994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:54.324164 13994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:54.325546 13994 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:54.325605 13994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:54.325618 13994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:54.325630 13994 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:54.325641 13994 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:54.327540 13994 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:44441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.103.84:47225/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:40599
--ranger_config_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:40599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=33863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:02:54.327808 13994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:54.328068 13994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:54.333525 14005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:54.333561 13994 server_base.cc:1034] running on GCE node
W20260812 00:02:54.333524 13999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:54.333544 14008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:54.333989 13994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:54.334328 13994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:54.335546 13994 hybrid_clock.cc:648] HybridClock initialized: now 1786492974335495 us; error 77 us; skew 500 ppm
Aug 12 00:02:54 dist-test-slave-vpvm krb5kdc[12379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492974, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:54.338321 13994 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:02:54.338868 13994 webserver.cc:460] Webserver started at http://127.25.103.126:33863/ using document root <none> and password file <none>
I20260812 00:02:54.339107 13994 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:54.339169 13994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:02:54 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492974, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
I20260812 00:02:54.413019 13994 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:54.414304 14019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:54.414577 13994 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:54.414700 13994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "e180734c72584b1f90cf28aea37ed761"
format_stamp: "Formatted at 2026-08-12 00:02:52 on dist-test-slave-vpvm"
server_key: "8d6f91a693022bcb2869653c42befd03"
server_key_iv: "b188b553cccfa7161ef62989b6b85a2b"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:54.415125 13994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:54.430377 13994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:54.432385 13994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:54.432554 13994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:54.436892 13994 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:40599
I20260812 00:02:54.436949 14121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:40599 every 8 connection(s)
I20260812 00:02:54.437345 13994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:02:54.438802 14126 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:02:54.439476 14126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761: Bootstrap starting.
I20260812 00:02:54.446271 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 13994
I20260812 00:02:54.446738 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.103.84:47225/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:37151
--local_ip_for_outbound_sockets=127.25.103.65
--tserver_master_addrs=127.25.103.126:40599
--webserver_port=40201
--webserver_interface=127.25.103.65
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:44441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.103.84:47225/kms with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:02:54.448361 14126 log.cc:824] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:54.450251 14126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:02:54.450533 14126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761: Bootstrap complete.
I20260812 00:02:54.452865 14126 raft_consensus.cc:348] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e180734c72584b1f90cf28aea37ed761" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 40599 } }
I20260812 00:02:54.453137 14126 raft_consensus.cc:729] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e180734c72584b1f90cf28aea37ed761, State: Initialized, Role: FOLLOWER
I20260812 00:02:54.453308 14126 consensus_queue.cc:260] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e180734c72584b1f90cf28aea37ed761" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 40599 } }
I20260812 00:02:54.453389 14126 raft_consensus.cc:388] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:02:54.453442 14126 raft_consensus.cc:482] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:02:54.453492 14126 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:02:54.454687 14126 raft_consensus.cc:504] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e180734c72584b1f90cf28aea37ed761" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 40599 } }
I20260812 00:02:54.454807 14126 leader_election.cc:302] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e180734c72584b1f90cf28aea37ed761; no voters:
I20260812 00:02:54.454990 14126 leader_election.cc:288] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:02:54.455045 14137 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:02:54.455201 14137 raft_consensus.cc:686] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [term 2 LEADER]: Becoming Leader. State: Replica: e180734c72584b1f90cf28aea37ed761, State: Running, Role: LEADER
I20260812 00:02:54.455297 14126 sys_catalog.cc:564] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:54.455367 14137 consensus_queue.cc:237] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e180734c72584b1f90cf28aea37ed761" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 40599 } }
I20260812 00:02:54.455742 14138 sys_catalog.cc:455] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e180734c72584b1f90cf28aea37ed761" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e180734c72584b1f90cf28aea37ed761" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 40599 } } }
I20260812 00:02:54.455830 14138 sys_catalog.cc:458] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:54.456126 14139 sys_catalog.cc:455] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e180734c72584b1f90cf28aea37ed761. Latest consensus state: current_term: 2 leader_uuid: "e180734c72584b1f90cf28aea37ed761" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e180734c72584b1f90cf28aea37ed761" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 40599 } } }
I20260812 00:02:54.456234 14139 sys_catalog.cc:458] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:54.456631 14147 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:02:54.456903 14126 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 00:02:54.457235 14147 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:02:54.460009 14147 catalog_manager.cc:1259] Loaded cluster ID: 407146da2f614c14b94720a25485083e
I20260812 00:02:54.460212 14147 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:02:54.462236 14147 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:54.462530 14147 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761: Loaded TSK: 0
I20260812 00:02:54.462780 14147 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:02:54.549918 14132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:54.550182 14132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:54.550220 14132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:54.551594 14132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:54.551656 14132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:54.551700 14132 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:02:54.553694 14132 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:44441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.103.84:47225/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:37151
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=40201
--tserver_master_addrs=127.25.103.126:40599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:02:54.554005 14132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:54.554267 14132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:54.560286 14192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:54.560286 14194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:54.561126 14190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:54.561300 14132 server_base.cc:1034] running on GCE node
I20260812 00:02:54.561503 14132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:54.561853 14132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:54.569363 14132 hybrid_clock.cc:648] HybridClock initialized: now 1786492974569324 us; error 57 us; skew 500 ppm
Aug 12 00:02:54 dist-test-slave-vpvm krb5kdc[12379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492974, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:54.572844 14132 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:02:54.573560 14132 webserver.cc:460] Webserver started at http://127.25.103.65:40201/ using document root <none> and password file <none>
I20260812 00:02:54.573865 14132 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:54.574012 14132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:02:54 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492974, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
I20260812 00:02:54.602475 14132 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:02:54.604171 14209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:54.604480 14132 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260812 00:02:54.604624 14132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "54a17944ad474bbab5c160d53ff98c2c"
format_stamp: "Formatted at 2026-08-12 00:02:53 on dist-test-slave-vpvm"
server_key: "0c67886455cadc5a1ca2e1c5c9822e51"
server_key_iv: "b8c3d86693d7c3aa6d2bb88c712e222d"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:54.605167 14132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:54.623178 14132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:54.626075 14132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:54.626251 14132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:54.626531 14132 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:54.626966 14132 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:54.627079 14132 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:54.627189 14132 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:54.627225 14132 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:54.637034 14132 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:37151
I20260812 00:02:54.637670 14132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:02:54.642740 14403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:37151 every 8 connection(s)
I20260812 00:02:54.644663 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 14132
I20260812 00:02:54.644999 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.103.84:47225/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:43503
--local_ip_for_outbound_sockets=127.25.103.66
--tserver_master_addrs=127.25.103.126:40599
--webserver_port=34449
--webserver_interface=127.25.103.66
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:44441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.103.84:47225/kms with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:02:54 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492974, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:02:54.654173 14408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:54.640040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:40599 (local address 127.25.103.65:57441)
0812 00:02:54.640275 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:54.640359 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:54.641191 (+ 832us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:54.642083 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:54.642090 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:54.642484 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:54.643016 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:54.643033 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:54.645156 (+ 2123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:54.645158 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:54.646451 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:54.646456 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:54.647341 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:54.647343 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:54.647492 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:54.648176 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:54.648188 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:54.649918 (+ 1730us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:54.652041 (+ 2123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:54.652048 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:54.652051 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:54.652337 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:54.652615 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:54.652616 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:54.652616 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:54.652787 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:54.653362 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:54.653369 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:54.653538 (+ 169us) client_negotiation.cc:769] Sending connection context
0812 00:02:54.653635 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 00:02:54.653829 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":103,"threads_started":1}
I20260812 00:02:54.654855 14411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:54.640295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:57441 (local address 127.25.103.126:40599)
0812 00:02:54.641459 (+ 1164us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:54.641470 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:54.641525 (+ 55us) server_negotiation.cc:407] Connection header received
0812 00:02:54.641723 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:54.641730 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:54.641790 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:54.643278 (+ 1488us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:54.643463 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:54.644984 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:54.646584 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:54.647214 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:54.647833 (+ 619us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:54.650076 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:54.650080 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:54.650080 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:54.650093 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:54.651937 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:54.652420 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:54.652423 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:54.652423 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:54.652526 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:54.652890 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:54.652892 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:54.652892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:54.653263 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:54.654351 (+ 1088us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:54.654456 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 00:02:54.654602 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1094,"thread_start_us":109,"threads_started":1}
I20260812 00:02:54.655695 14405 heartbeater.cc:347] Connected to a master server at 127.25.103.126:40599
I20260812 00:02:54.655905 14405 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:54.656224 14405 heartbeater.cc:511] Master 127.25.103.126:40599 requested a full tablet report, sending...
W20260812 00:02:54.657191 14405 heartbeater.cc:644] Failed to heartbeat to 127.25.103.126:40599 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 00:02:54.657308 14405 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:54.657418 14405 heartbeater.cc:511] Master 127.25.103.126:40599 requested a full tablet report, sending...
I20260812 00:02:54.657802 14405 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:54.657919 14405 heartbeater.cc:511] Master 127.25.103.126:40599 requested a full tablet report, sending...
W20260812 00:02:54.658319 14405 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:02:54.771744 14414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:54.772080 14414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:54.772132 14414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:54.774003 14414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:54.774075 14414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:54.774111 14414 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:02:54.776036 14414 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:44441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.103.84:47225/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:43503
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=34449
--tserver_master_addrs=127.25.103.126:40599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:02:54.776336 14414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:54.776638 14414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:54.782812 14423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:54.784019 14426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:54.784418 14420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:54.785020 14414 server_base.cc:1034] running on GCE node
I20260812 00:02:54.785378 14414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:54.785897 14414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:54.787174 14414 hybrid_clock.cc:648] HybridClock initialized: now 1786492974787136 us; error 52 us; skew 500 ppm
Aug 12 00:02:54 dist-test-slave-vpvm krb5kdc[12379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492974, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:54.790771 14414 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:02:54.791460 14414 webserver.cc:460] Webserver started at http://127.25.103.66:34449/ using document root <none> and password file <none>
I20260812 00:02:54.791706 14414 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:54.791778 14414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:02:54 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492974, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
I20260812 00:02:54.822607 14414 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.001s sys 0.000s
I20260812 00:02:54.824692 14440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:54.824957 14414 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 00:02:54.825078 14414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "0d163010d30a451aa4f8aa805f9fc6bd"
format_stamp: "Formatted at 2026-08-12 00:02:53 on dist-test-slave-vpvm"
server_key: "8108e2e5b69683955fd639154c6e629e"
server_key_iv: "8eb49e3bdb4661b353de2059874bb073"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:54.825656 14414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:54.839425 14414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:54.842219 14414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:54.842408 14414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:54.842722 14414 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:54.843156 14414 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:54.843209 14414 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:54.843240 14414 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:54.843266 14414 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:54.850096 14414 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:43503
I20260812 00:02:54.850648 14414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:02:54.850888 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 14414
I20260812 00:02:54.851178 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.103.84:47225/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:34247
--local_ip_for_outbound_sockets=127.25.103.67
--tserver_master_addrs=127.25.103.126:40599
--webserver_port=45809
--webserver_interface=127.25.103.67
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:44441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.103.84:47225/kms with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:02:54.862810 14641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:43503 every 8 connection(s)
Aug 12 00:02:54 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492974, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:02:54.896005 14411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:54.864491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:33803 (local address 127.25.103.126:40599)
0812 00:02:54.864547 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:54.864550 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:54.866664 (+ 2114us) server_negotiation.cc:407] Connection header received
0812 00:02:54.867999 (+ 1335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:54.868001 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:54.868021 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:54.868054 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:54.869727 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:54.870572 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:54.884379 (+ 13807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:54.884739 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:54.884799 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:54.891510 (+ 6711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:54.891513 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:54.891513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:54.891526 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:54.893308 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:54.894107 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:54.894108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:54.894108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:54.894182 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:54.894516 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:54.894517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:54.894517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:54.894686 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:54.894751 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:54.895762 (+ 1011us) server_negotiation.cc:299] Negotiation successful
0812 00:02:54.895894 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:02:54.896931 14650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:54.864070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:40599 (local address 127.25.103.66:33803)
0812 00:02:54.866241 (+ 2171us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:54.866320 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:54.867834 (+ 1514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:54.868618 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:54.868624 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:54.868912 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:54.869579 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:54.869588 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:54.870713 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:54.870714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:54.877108 (+ 6394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:54.877118 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:54.884966 (+ 7848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:54.884968 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:54.885173 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:54.887158 (+ 1985us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:54.887171 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:54.891295 (+ 4124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:54.893441 (+ 2146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:54.893455 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:54.893458 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:54.894002 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:54.894260 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:54.894261 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:54.894262 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:54.894416 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:54.894815 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:54.894822 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:54.895007 (+ 185us) client_negotiation.cc:769] Sending connection context
0812 00:02:54.896445 (+ 1438us) client_negotiation.cc:240] Negotiation successful
0812 00:02:54.896675 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2031,"thread_start_us":138,"threads_started":1}
I20260812 00:02:54.898689 14645 heartbeater.cc:347] Connected to a master server at 127.25.103.126:40599
I20260812 00:02:54.898803 14645 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:54.899025 14645 heartbeater.cc:511] Master 127.25.103.126:40599 requested a full tablet report, sending...
W20260812 00:02:54.899807 14645 heartbeater.cc:644] Failed to heartbeat to 127.25.103.126:40599 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 00:02:54.899892 14645 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:54.899981 14645 heartbeater.cc:511] Master 127.25.103.126:40599 requested a full tablet report, sending...
I20260812 00:02:54.900360 14645 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:54.900440 14645 heartbeater.cc:511] Master 127.25.103.126:40599 requested a full tablet report, sending...
W20260812 00:02:54.900799 14645 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:02:54.970597 14649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:54.970836 14649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:54.970871 14649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:54.972267 14649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:54.972325 14649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:54.972366 14649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:02:54.974092 14649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:44441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.103.84:47225/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:34247
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=45809
--tserver_master_addrs=127.25.103.126:40599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:02:54.974359 14649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:54.974602 14649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:54.980334 14659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:54.980389 14661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:54.981105 14658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:54.981909 14649 server_base.cc:1034] running on GCE node
I20260812 00:02:54.982415 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:54.982817 14649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:54.983995 14649 hybrid_clock.cc:648] HybridClock initialized: now 1786492974983968 us; error 51 us; skew 500 ppm
Aug 12 00:02:54 dist-test-slave-vpvm krb5kdc[12379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492974, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:54.987716 14649 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:02:54.988363 14649 webserver.cc:460] Webserver started at http://127.25.103.67:45809/ using document root <none> and password file <none>
I20260812 00:02:54.988680 14649 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:54.988786 14649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:02:54 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492974, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
I20260812 00:02:55.018684 14649 fs_manager.cc:709] Time spent opening directory manager: real 0.010s user 0.001s sys 0.000s
I20260812 00:02:55.019994 14671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:55.020287 14649 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:55.020407 14649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "900c5b87b4ce4fc186ad3097c4a03670"
format_stamp: "Formatted at 2026-08-12 00:02:53 on dist-test-slave-vpvm"
server_key: "03d754232dde53453616669ffd2e1a41"
server_key_iv: "30ddadadac0881d5e370e23176f71a07"
server_key_version: "kuduclusterkey@0"
I20260812 00:02:55.021355 14649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:55.052951 14649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:55.055588 14649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:55.055759 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:55.056058 14649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:55.056457 14649 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:55.056511 14649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:55.056550 14649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:55.056571 14649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:55.064000 14649 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:34247
I20260812 00:02:55.064571 14649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:02:55.068917 14863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:34247 every 8 connection(s)
I20260812 00:02:55.069895 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 14649
Aug 12 00:02:55 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492974, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:02:55.076568 14411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:55.065457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:48335 (local address 127.25.103.126:40599)
0812 00:02:55.065523 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:55.065525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:55.065767 (+ 242us) server_negotiation.cc:407] Connection header received
0812 00:02:55.066527 (+ 760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:55.066529 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:55.066542 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:55.066597 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:55.067226 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:55.067986 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:55.069464 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:55.069758 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:55.069805 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:55.072839 (+ 3034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:55.072841 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:55.072842 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:55.072850 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:55.074657 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:55.075247 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:55.075249 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:55.075249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:55.075330 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:55.075708 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:55.075709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:55.075710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:55.075871 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:55.075918 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:55.076363 (+ 445us) server_negotiation.cc:299] Negotiation successful
0812 00:02:55.076471 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:02:55.076802 14868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:55.065435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:40599 (local address 127.25.103.67:48335)
0812 00:02:55.065621 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:55.065672 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:55.066408 (+ 736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:55.066675 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:55.066680 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:55.066874 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:55.067107 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:55.067114 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:55.068132 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:55.068132 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:55.069354 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:55.069357 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:55.069933 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:55.069934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:55.070127 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:55.070952 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:55.070965 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:55.072704 (+ 1739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:55.074760 (+ 2056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:55.074770 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:55.074773 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:55.075145 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:55.075433 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:55.075434 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:55.075434 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:55.075614 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:55.075972 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:55.075979 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:55.076179 (+ 200us) client_negotiation.cc:769] Sending connection context
0812 00:02:55.076316 (+ 137us) client_negotiation.cc:240] Negotiation successful
0812 00:02:55.076534 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":95,"threads_started":1}
I20260812 00:02:55.077297 14864 heartbeater.cc:347] Connected to a master server at 127.25.103.126:40599
I20260812 00:02:55.077406 14864 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:55.077636 14864 heartbeater.cc:511] Master 127.25.103.126:40599 requested a full tablet report, sending...
W20260812 00:02:55.078348 14864 heartbeater.cc:644] Failed to heartbeat to 127.25.103.126:40599 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 00:02:55.078420 14864 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:55.078500 14864 heartbeater.cc:511] Master 127.25.103.126:40599 requested a full tablet report, sending...
I20260812 00:02:55.078822 14864 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:55.078893 14864 heartbeater.cc:511] Master 127.25.103.126:40599 requested a full tablet report, sending...
W20260812 00:02:55.079519 14864 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:02:55.085583 14872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:55.070556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48334 (local address 127.25.103.126:40599)
0812 00:02:55.074650 (+ 4094us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:55.074652 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:55.074663 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:02:55.075285 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:55.075287 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:55.075313 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:55.075389 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:55.076544 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:55.077416 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:55.080381 (+ 2965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:55.080626 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:55.080755 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:55.082521 (+ 1766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:55.082523 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:55.082523 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:55.082533 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:55.084297 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:55.084684 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:55.084686 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:55.084686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:55.084757 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:55.084931 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:55.084931 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:55.084932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:55.085067 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:55.085267 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:55.085303 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 00:02:55.085393 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4066,"thread_start_us":67,"threads_started":1}
I20260812 00:02:55.658540 14405 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:55.658717 14405 heartbeater.cc:511] Master 127.25.103.126:40599 requested a full tablet report, sending...
I20260812 00:02:55.659142 14043 ts_manager.cc:194] Registered new tserver with Master: 54a17944ad474bbab5c160d53ff98c2c (127.25.103.65:37151)
I20260812 00:02:55.660187 14043 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:57441
Aug 12 00:02:55 dist-test-slave-vpvm krb5kdc[12379](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786492975, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:55.901005 14645 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:55.901213 14645 heartbeater.cc:511] Master 127.25.103.126:40599 requested a full tablet report, sending...
I20260812 00:02:55.901726 14043 ts_manager.cc:194] Registered new tserver with Master: 0d163010d30a451aa4f8aa805f9fc6bd (127.25.103.66:43503)
I20260812 00:02:55.902526 14043 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:33803
I20260812 00:02:56.079818 14864 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:56.080021 14864 heartbeater.cc:511] Master 127.25.103.126:40599 requested a full tablet report, sending...
I20260812 00:02:56.080570 14043 ts_manager.cc:194] Registered new tserver with Master: 900c5b87b4ce4fc186ad3097c4a03670 (127.25.103.67:34247)
I20260812 00:02:56.081103 14043 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:48335
I20260812 00:02:56.084093 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:02:56.109613 14898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:56.085546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48348 (local address 127.25.103.126:40599)
0812 00:02:56.085854 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:56.085857 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:56.085865 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:56.085895 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:56.085896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:56.085911 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:56.086032 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:56.086991 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.088487 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.099153 (+ 10666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.099591 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.100454 (+ 863us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:56.101611 (+ 1157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:56.101614 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:56.101614 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:56.101623 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:56.106381 (+ 4758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:56.107253 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:56.107255 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:56.107255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:56.107364 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:56.107601 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:56.107602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:56.107603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:56.107813 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:56.109186 (+ 1373us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:56.109238 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 00:02:56.109461 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":128,"threads_started":1}
I20260812 00:02:56.113009 14043 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48348:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:02:56.115947 14043 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 12 00:02:56 dist-test-slave-vpvm krb5kdc[12379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492975, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for HTTP/127.25.103.84@KRBTEST.COM
I20260812 00:02:56.131301 14912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:56.120081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:43503 (local address 127.0.0.1:56904)
0812 00:02:56.121637 (+ 1556us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:56.121690 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:56.121762 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:56.122172 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:56.122175 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:56.122178 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:56.122265 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:56.122268 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.127274 (+ 5006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.127276 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:56.128481 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:56.128486 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.130889 (+ 2403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.130891 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:56.131003 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:56.131030 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 00:02:56.131093 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:02:56.131161 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1380,"thread_start_us":74,"threads_started":1}
I20260812 00:02:56.133670 14911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:56.120535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56904 (local address 127.25.103.66:43503)
0812 00:02:56.121898 (+ 1363us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:56.121902 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:56.121912 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:02:56.121973 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:56.121975 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:56.121992 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:56.122060 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:56.122349 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.127040 (+ 4691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.129251 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.130689 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.130789 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:56.133482 (+ 2693us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:56.133517 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 00:02:56.133583 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1326,"thread_start_us":63,"threads_started":1}
I20260812 00:02:56.133663 14909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:56.120795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:37151 (local address 127.0.0.1:54364)
0812 00:02:56.123735 (+ 2940us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:56.123744 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:56.123812 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:56.124211 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:56.124212 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:56.124214 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:56.124268 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:56.124270 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.125464 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.125465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:56.132012 (+ 6547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:56.132029 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.133342 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.133344 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:56.133424 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:56.133430 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:02:56.133506 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 00:02:56.133565 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2926,"thread_start_us":73,"threads_started":1}
I20260812 00:02:56.134102 14913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:56.121012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54364 (local address 127.25.103.65:37151)
0812 00:02:56.121611 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:56.121617 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:56.123879 (+ 2262us) server_negotiation.cc:407] Connection header received
0812 00:02:56.123935 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:56.123938 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:56.123955 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:56.124031 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:56.124333 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.125355 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.132127 (+ 6772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.133225 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.133312 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:56.133382 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:56.133875 (+ 493us) server_negotiation.cc:299] Negotiation successful
0812 00:02:56.133936 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":57,"threads_started":1}
I20260812 00:02:56.135048 14287 tablet_service.cc:1467] Processing CreateTablet for tablet f9ec9778f71142d49a30f0ba1c354e42 (DEFAULT_TABLE table=test-table [id=e79db96f38764a38a89e26d39dbff5ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:56.135092 14515 tablet_service.cc:1467] Processing CreateTablet for tablet f9ec9778f71142d49a30f0ba1c354e42 (DEFAULT_TABLE table=test-table [id=e79db96f38764a38a89e26d39dbff5ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:56.135460 14287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9ec9778f71142d49a30f0ba1c354e42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:56.135495 14515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9ec9778f71142d49a30f0ba1c354e42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:56.146413 14908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:56.120316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:34247 (local address 127.0.0.1:58972)
0812 00:02:56.123592 (+ 3276us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:56.123605 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:56.124160 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:56.134057 (+ 9897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:56.134059 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:56.134062 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:56.134113 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:56.134115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.143102 (+ 8987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.143104 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:56.144743 (+ 1639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:56.144749 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.146131 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.146133 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:56.146216 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:56.146223 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 00:02:56.146253 (+ 30us) client_negotiation.cc:240] Negotiation successful
0812 00:02:56.146313 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3252,"thread_start_us":60,"threads_started":1}
I20260812 00:02:56.147643 14910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:56.120454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58972 (local address 127.25.103.67:34247)
0812 00:02:56.133726 (+ 13272us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:56.133732 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:56.133746 (+ 14us) server_negotiation.cc:407] Connection header received
0812 00:02:56.133789 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:56.133791 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:56.133813 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:56.133902 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:56.141369 (+ 7467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.142956 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.144877 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.145935 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.146861 (+ 926us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:56.146967 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:56.147001 (+ 34us) server_negotiation.cc:299] Negotiation successful
0812 00:02:56.147069 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13222,"thread_start_us":74,"threads_started":1}
I20260812 00:02:56.148156 14914 tablet_bootstrap.cc:492] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c: Bootstrap starting.
I20260812 00:02:56.148429 14916 tablet_bootstrap.cc:492] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd: Bootstrap starting.
I20260812 00:02:56.148932 14748 tablet_service.cc:1467] Processing CreateTablet for tablet f9ec9778f71142d49a30f0ba1c354e42 (DEFAULT_TABLE table=test-table [id=e79db96f38764a38a89e26d39dbff5ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:56.149504 14748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9ec9778f71142d49a30f0ba1c354e42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:56.150161 14914 tablet_bootstrap.cc:654] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:56.150631 14916 tablet_bootstrap.cc:654] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:56.151099 14914 log.cc:824] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:56.151521 14916 log.cc:824] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:56.152990 14914 tablet_bootstrap.cc:492] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c: No bootstrap required, opened a new log
I20260812 00:02:56.153182 14914 ts_tablet_manager.cc:1397] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260812 00:02:56.156183 14914 raft_consensus.cc:348] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d163010d30a451aa4f8aa805f9fc6bd" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43503 } } peers { permanent_uuid: "900c5b87b4ce4fc186ad3097c4a03670" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34247 } } peers { permanent_uuid: "54a17944ad474bbab5c160d53ff98c2c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37151 } }
I20260812 00:02:56.156569 14914 raft_consensus.cc:374] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:56.156687 14914 raft_consensus.cc:729] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54a17944ad474bbab5c160d53ff98c2c, State: Initialized, Role: FOLLOWER
I20260812 00:02:56.156884 14914 consensus_queue.cc:260] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d163010d30a451aa4f8aa805f9fc6bd" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43503 } } peers { permanent_uuid: "900c5b87b4ce4fc186ad3097c4a03670" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34247 } } peers { permanent_uuid: "54a17944ad474bbab5c160d53ff98c2c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37151 } }
I20260812 00:02:56.157707 14914 ts_tablet_manager.cc:1428] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260812 00:02:56.158025 14405 heartbeater.cc:503] Master 127.25.103.126:40599 was elected leader, sending a full tablet report...
I20260812 00:02:56.159895 14916 tablet_bootstrap.cc:492] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd: No bootstrap required, opened a new log
I20260812 00:02:56.160105 14916 ts_tablet_manager.cc:1397] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260812 00:02:56.166283 14920 tablet_bootstrap.cc:492] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670: Bootstrap starting.
I20260812 00:02:56.167214 14920 tablet_bootstrap.cc:654] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:56.167697 14920 log.cc:824] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:56.179483 14920 tablet_bootstrap.cc:492] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670: No bootstrap required, opened a new log
I20260812 00:02:56.179613 14920 ts_tablet_manager.cc:1397] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260812 00:02:56.184584 14920 raft_consensus.cc:348] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d163010d30a451aa4f8aa805f9fc6bd" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43503 } } peers { permanent_uuid: "900c5b87b4ce4fc186ad3097c4a03670" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34247 } } peers { permanent_uuid: "54a17944ad474bbab5c160d53ff98c2c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37151 } }
I20260812 00:02:56.184926 14920 raft_consensus.cc:374] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:56.185250 14920 raft_consensus.cc:729] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 900c5b87b4ce4fc186ad3097c4a03670, State: Initialized, Role: FOLLOWER
I20260812 00:02:56.186293 14920 consensus_queue.cc:260] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d163010d30a451aa4f8aa805f9fc6bd" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43503 } } peers { permanent_uuid: "900c5b87b4ce4fc186ad3097c4a03670" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34247 } } peers { permanent_uuid: "54a17944ad474bbab5c160d53ff98c2c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37151 } }
I20260812 00:02:56.186829 14920 ts_tablet_manager.cc:1428] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 00:02:56.186996 14864 heartbeater.cc:503] Master 127.25.103.126:40599 was elected leader, sending a full tablet report...
I20260812 00:02:56.189014 14916 raft_consensus.cc:348] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d163010d30a451aa4f8aa805f9fc6bd" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43503 } } peers { permanent_uuid: "900c5b87b4ce4fc186ad3097c4a03670" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34247 } } peers { permanent_uuid: "54a17944ad474bbab5c160d53ff98c2c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37151 } }
I20260812 00:02:56.189379 14916 raft_consensus.cc:374] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:56.189481 14916 raft_consensus.cc:729] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d163010d30a451aa4f8aa805f9fc6bd, State: Initialized, Role: FOLLOWER
I20260812 00:02:56.189707 14916 consensus_queue.cc:260] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d163010d30a451aa4f8aa805f9fc6bd" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43503 } } peers { permanent_uuid: "900c5b87b4ce4fc186ad3097c4a03670" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34247 } } peers { permanent_uuid: "54a17944ad474bbab5c160d53ff98c2c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37151 } }
I20260812 00:02:56.191316 14921 raft_consensus.cc:482] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:02:56.191491 14916 ts_tablet_manager.cc:1428] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd: Time spent starting tablet: real 0.031s user 0.004s sys 0.005s
I20260812 00:02:56.191573 14921 raft_consensus.cc:504] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d163010d30a451aa4f8aa805f9fc6bd" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43503 } } peers { permanent_uuid: "900c5b87b4ce4fc186ad3097c4a03670" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34247 } } peers { permanent_uuid: "54a17944ad474bbab5c160d53ff98c2c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37151 } }
I20260812 00:02:56.191650 14645 heartbeater.cc:503] Master 127.25.103.126:40599 was elected leader, sending a full tablet report...
I20260812 00:02:56.191955 14921 leader_election.cc:288] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d163010d30a451aa4f8aa805f9fc6bd (127.25.103.66:43503), 900c5b87b4ce4fc186ad3097c4a03670 (127.25.103.67:34247)
I20260812 00:02:56.197821 14911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:56.192759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:38133 (local address 127.25.103.66:43503)
0812 00:02:56.192985 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:56.192987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:56.192998 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:02:56.193086 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:56.193088 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:56.193098 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:56.193124 (+ 26us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:56.193560 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.194298 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.196200 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.196838 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.196893 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:56.196903 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:56.197679 (+ 776us) server_negotiation.cc:299] Negotiation successful
0812 00:02:56.197738 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203}
I20260812 00:02:56.199213 14931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:56.192231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:43503 (local address 127.25.103.65:38133)
0812 00:02:56.192909 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:56.192921 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:56.192992 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:56.193193 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:56.193194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:56.193196 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:56.193458 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:56.193462 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.194404 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.194405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:56.196077 (+ 1672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:56.196083 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.197135 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.197138 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:56.197284 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:56.197290 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:02:56.197930 (+ 640us) client_negotiation.cc:240] Negotiation successful
0812 00:02:56.198877 (+ 947us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":119,"threads_started":1}
I20260812 00:02:56.200083 14536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9ec9778f71142d49a30f0ba1c354e42" candidate_uuid: "54a17944ad474bbab5c160d53ff98c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d163010d30a451aa4f8aa805f9fc6bd" is_pre_election: true
I20260812 00:02:56.200297 14536 raft_consensus.cc:2454] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54a17944ad474bbab5c160d53ff98c2c in term 0.
I20260812 00:02:56.200676 14213 leader_election.cc:302] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d163010d30a451aa4f8aa805f9fc6bd, 54a17944ad474bbab5c160d53ff98c2c; no voters:
I20260812 00:02:56.200851 14921 raft_consensus.cc:2781] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:02:56.200901 14921 raft_consensus.cc:482] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:02:56.200920 14921 raft_consensus.cc:3037] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:56.202663 14921 raft_consensus.cc:504] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d163010d30a451aa4f8aa805f9fc6bd" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43503 } } peers { permanent_uuid: "900c5b87b4ce4fc186ad3097c4a03670" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34247 } } peers { permanent_uuid: "54a17944ad474bbab5c160d53ff98c2c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37151 } }
I20260812 00:02:56.202847 14921 leader_election.cc:288] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [CANDIDATE]: Term 1 election: Requested vote from peers 0d163010d30a451aa4f8aa805f9fc6bd (127.25.103.66:43503), 900c5b87b4ce4fc186ad3097c4a03670 (127.25.103.67:34247)
I20260812 00:02:56.203169 14536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9ec9778f71142d49a30f0ba1c354e42" candidate_uuid: "54a17944ad474bbab5c160d53ff98c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d163010d30a451aa4f8aa805f9fc6bd"
I20260812 00:02:56.203291 14536 raft_consensus.cc:3037] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:56.204840 14536 raft_consensus.cc:2454] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54a17944ad474bbab5c160d53ff98c2c in term 1.
I20260812 00:02:56.205106 14213 leader_election.cc:302] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d163010d30a451aa4f8aa805f9fc6bd, 54a17944ad474bbab5c160d53ff98c2c; no voters:
I20260812 00:02:56.205206 14921 raft_consensus.cc:2781] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:56.205492 14921 raft_consensus.cc:686] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [term 1 LEADER]: Becoming Leader. State: Replica: 54a17944ad474bbab5c160d53ff98c2c, State: Running, Role: LEADER
I20260812 00:02:56.205612 14921 consensus_queue.cc:237] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d163010d30a451aa4f8aa805f9fc6bd" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43503 } } peers { permanent_uuid: "900c5b87b4ce4fc186ad3097c4a03670" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34247 } } peers { permanent_uuid: "54a17944ad474bbab5c160d53ff98c2c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37151 } }
I20260812 00:02:56.208966 14043 catalog_manager.cc:5495] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 54a17944ad474bbab5c160d53ff98c2c (127.25.103.65). New cstate: current_term: 1 leader_uuid: "54a17944ad474bbab5c160d53ff98c2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d163010d30a451aa4f8aa805f9fc6bd" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "900c5b87b4ce4fc186ad3097c4a03670" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54a17944ad474bbab5c160d53ff98c2c" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 37151 } health_report { overall_health: HEALTHY } } }
I20260812 00:02:56.215775 14910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:56.192671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:37061 (local address 127.25.103.67:34247)
0812 00:02:56.192722 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:56.192724 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:56.209541 (+ 16817us) server_negotiation.cc:407] Connection header received
0812 00:02:56.210511 (+ 970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:56.210513 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:56.210524 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:56.210553 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:56.210754 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.211496 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.214732 (+ 3236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.215379 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.215433 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:56.215442 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:56.215646 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 00:02:56.215692 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:02:56.216101 14931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:56.192488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:34247 (local address 127.25.103.65:37061)
0812 00:02:56.209454 (+ 16966us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:56.209471 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:56.210396 (+ 925us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:56.210640 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:56.210641 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:56.210643 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:56.210693 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:56.210694 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.211643 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.211644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:56.214613 (+ 2969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:56.214619 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.215509 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.215510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:56.215575 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:56.215578 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:02:56.215939 (+ 361us) client_negotiation.cc:240] Negotiation successful
0812 00:02:56.216026 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16949,"thread_start_us":79,"threads_started":1}
I20260812 00:02:56.216647 14782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9ec9778f71142d49a30f0ba1c354e42" candidate_uuid: "54a17944ad474bbab5c160d53ff98c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "900c5b87b4ce4fc186ad3097c4a03670"
I20260812 00:02:56.216777 14783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9ec9778f71142d49a30f0ba1c354e42" candidate_uuid: "54a17944ad474bbab5c160d53ff98c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "900c5b87b4ce4fc186ad3097c4a03670" is_pre_election: true
I20260812 00:02:56.216825 14782 raft_consensus.cc:3037] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:56.218653 14782 raft_consensus.cc:2454] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54a17944ad474bbab5c160d53ff98c2c in term 1.
I20260812 00:02:56.224032 14913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:56.220658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54376 (local address 127.25.103.65:37151)
0812 00:02:56.220732 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:56.220735 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:56.220749 (+ 14us) server_negotiation.cc:407] Connection header received
0812 00:02:56.220789 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:56.220790 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:56.220811 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:56.220912 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:02:56.221092 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.221784 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.222894 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:56.223205 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:56.223261 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:56.223451 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:02:56.223597 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:02:56.223668 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:56.223909 (+ 241us) server_negotiation.cc:299] Negotiation successful
0812 00:02:56.223934 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 00:02:56.227326 14782 raft_consensus.cc:1261] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670 [term 1 FOLLOWER]: Refusing update from remote peer 54a17944ad474bbab5c160d53ff98c2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:56.227874 14934 consensus_queue.cc:1035] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "900c5b87b4ce4fc186ad3097c4a03670" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:56.231570 14536 raft_consensus.cc:1261] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd [term 1 FOLLOWER]: Refusing update from remote peer 54a17944ad474bbab5c160d53ff98c2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:56.231972 14934 consensus_queue.cc:1035] T f9ec9778f71142d49a30f0ba1c354e42 P 54a17944ad474bbab5c160d53ff98c2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d163010d30a451aa4f8aa805f9fc6bd" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:56.239275 14938 mvcc.cc:205] Tried to move back new op lower bound from 7317475230622322688 to 7317475230538903552. Current Snapshot: MvccSnapshot[applied={T|T < 7317475230622322688}]
I20260812 00:02:56.239499 14948 mvcc.cc:205] Tried to move back new op lower bound from 7317475230622322688 to 7317475230538903552. Current Snapshot: MvccSnapshot[applied={T|T < 7317475230622322688}]
I20260812 00:02:56.245604 14043 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:56.245759 14043 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:56.246670 14043 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e180734c72584b1f90cf28aea37ed761: Sending DeleteTablet for 3 replicas of tablet f9ec9778f71142d49a30f0ba1c354e42
I20260812 00:02:56.247368 14748 tablet_service.cc:1514] Processing DeleteTablet for tablet f9ec9778f71142d49a30f0ba1c354e42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:56 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:58972
I20260812 00:02:56.247510 14515 tablet_service.cc:1514] Processing DeleteTablet for tablet f9ec9778f71142d49a30f0ba1c354e42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:56 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:56904
I20260812 00:02:56.254134 14965 tablet_replica.cc:330] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd: stopping tablet replica
I20260812 00:02:56.255271 14287 tablet_service.cc:1514] Processing DeleteTablet for tablet f9ec9778f71142d49a30f0ba1c354e42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:56 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:54364
I20260812 00:02:56.256616 14965 raft_consensus.cc:2229] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:56.257774 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 14132
I20260812 00:02:56.263861 14965 raft_consensus.cc:2258] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:56.264204 14964 tablet_replica.cc:330] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670: stopping tablet replica
I20260812 00:02:56.264354 14964 raft_consensus.cc:2229] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:56.264463 14964 raft_consensus.cc:2258] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:56.271018 14965 ts_tablet_manager.cc:1905] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:56.275220 14965 ts_tablet_manager.cc:1918] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:56.275333 14965 log.cc:1196] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/f9ec9778f71142d49a30f0ba1c354e42
I20260812 00:02:56.275595 14965 ts_tablet_manager.cc:1939] T f9ec9778f71142d49a30f0ba1c354e42 P 0d163010d30a451aa4f8aa805f9fc6bd: Deleting consensus metadata
I20260812 00:02:56.276427 14023 catalog_manager.cc:4841] TS 0d163010d30a451aa4f8aa805f9fc6bd (127.25.103.66:43503): tablet f9ec9778f71142d49a30f0ba1c354e42 (table test-table [id=e79db96f38764a38a89e26d39dbff5ca]) successfully deleted
I20260812 00:02:56.277665 14964 ts_tablet_manager.cc:1905] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:56.279946 14964 ts_tablet_manager.cc:1918] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:56.280083 14964 log.cc:1196] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/f9ec9778f71142d49a30f0ba1c354e42
I20260812 00:02:56.280447 14964 ts_tablet_manager.cc:1939] T f9ec9778f71142d49a30f0ba1c354e42 P 900c5b87b4ce4fc186ad3097c4a03670: Deleting consensus metadata
I20260812 00:02:56.281172 14020 catalog_manager.cc:4841] TS 900c5b87b4ce4fc186ad3097c4a03670 (127.25.103.67:34247): tablet f9ec9778f71142d49a30f0ba1c354e42 (table test-table [id=e79db96f38764a38a89e26d39dbff5ca]) successfully deleted
W20260812 00:02:56.296989 14021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.103.65:37151 (error 108)
I20260812 00:02:56.298156 14908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:56.298011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:37151 (local address 127.0.0.1:54390)
0812 00:02:56.298071 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:56.298109 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:37151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 00:02:56.298310 14021 catalog_manager.cc:4584] TS 54a17944ad474bbab5c160d53ff98c2c (127.25.103.65:37151): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f9ec9778f71142d49a30f0ba1c354e42: Network error: Client connection negotiation failed: client connection to 127.25.103.65:37151: connect: Connection refused (error 111)
I20260812 00:02:56.298520 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 14414
I20260812 00:02:56.351634 14908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:56.351459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:37151 (local address 127.0.0.1:54404)
0812 00:02:56.351530 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:56.351566 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:37151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 00:02:56.351977 14908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:56.351902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:37151 (local address 127.0.0.1:54410)
0812 00:02:56.351932 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:56.351954 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:37151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260812 00:02:56.352190 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 14649
I20260812 00:02:56.377174 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 13994
I20260812 00:02:56.398943 26013 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 00:02:56.746003 26013 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 00:02:56.746150 26013 mini_ranger.cc:66] Stopping Ranger...
I20260812 00:02:57.102635 26013 mini_ranger.cc:68] Stopped Ranger
2026-08-12 00:02:57.102 UTC [12427] LOG: received smart shutdown request
2026-08-12 00:02:57.107 UTC [12427] LOG: background worker "logical replication launcher" (PID 12440) exited with exit code 1
2026-08-12 00:02:57.108 UTC [12431] LOG: shutting down
2026-08-12 00:02:57.323 UTC [12427] LOG: database system is shut down
2026-08-12T00:02:57Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (55558 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:02:57 dist-test-slave-vpvm krb5kdc[14979](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:02:57 dist-test-slave-vpvm krb5kdc[14979](info): set up 2 sockets
Aug 12 00:02:57 dist-test-slave-vpvm krb5kdc[14979](info): commencing operation
krb5kdc: starting...
W20260812 00:02:58.667249 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.217s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:02:58 dist-test-slave-vpvm krb5kdc[14979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:02:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:02:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:02:58.797552 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:39455
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:38063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:39455,127.25.103.125:44601,127.25.103.124:44239
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:58.884588 15010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:58.884814 15010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:58.884836 15010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:58.885936 15010 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:58.886016 15010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:58.886036 15010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:58.886049 15010 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:58.886059 15010 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:58.887568 15010 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:38063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:39455,127.25.103.125:44601,127.25.103.124:44239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:39455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:02:58.887784 15010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:58.888144 15010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:58.894170 15024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:58.894170 15017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:58.894376 15010 server_base.cc:1034] running on GCE node
W20260812 00:02:58.894160 15018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:58.894663 15010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:58.894970 15010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:58.896149 15010 hybrid_clock.cc:648] HybridClock initialized: now 1786492978896126 us; error 34 us; skew 500 ppm
Aug 12 00:02:58 dist-test-slave-vpvm krb5kdc[14979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492978, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:58.899268 15010 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:02:58.899777 15010 webserver.cc:460] Webserver started at http://127.25.103.126:43419/ using document root <none> and password file <none>
I20260812 00:02:58.899986 15010 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:58.900033 15010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:58.900158 15010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:58.901259 15010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "fef7142db6834dd0a120c2295df2c597"
format_stamp: "Formatted at 2026-08-12 00:02:58 on dist-test-slave-vpvm"
server_key: "8446adf043b57fdca658ba23b6a21222"
server_key_iv: "87e74fdb9acbf1752a94fc8bf92373eb"
server_key_version: "encryptionkey@0"
I20260812 00:02:58.901618 15010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "fef7142db6834dd0a120c2295df2c597"
format_stamp: "Formatted at 2026-08-12 00:02:58 on dist-test-slave-vpvm"
server_key: "8446adf043b57fdca658ba23b6a21222"
server_key_iv: "87e74fdb9acbf1752a94fc8bf92373eb"
server_key_version: "encryptionkey@0"
I20260812 00:02:58.903097 15010 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:02:58.904035 15035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:58.904307 15010 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:02:58.904394 15010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "fef7142db6834dd0a120c2295df2c597"
format_stamp: "Formatted at 2026-08-12 00:02:58 on dist-test-slave-vpvm"
server_key: "8446adf043b57fdca658ba23b6a21222"
server_key_iv: "87e74fdb9acbf1752a94fc8bf92373eb"
server_key_version: "encryptionkey@0"
I20260812 00:02:58.904475 15010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:58.918524 15010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:58.920974 15010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:58.921123 15010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:58.925765 15010 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:39455
I20260812 00:02:58.925858 15118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:39455 every 8 connection(s)
I20260812 00:02:58.926262 15010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:02:58.927150 15122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:58.928810 15122 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:02:58.933904 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 15010
I20260812 00:02:58.934060 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:02:58.934244 26013 external_mini_cluster.cc:1428] Setting key ae6c87da699f55f68c7290099c883808
Aug 12 00:02:58 dist-test-slave-vpvm krb5kdc[14979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492978, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.103.125@KRBTEST.COM; defaulting to no policy
I20260812 00:02:58.942261 15130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:58.929641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52554 (local address 127.25.103.126:39455)
0812 00:02:58.930141 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:58.930144 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:58.930178 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:02:58.930487 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:58.930489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:58.930507 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:58.930610 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:58.931324 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:58.933888 (+ 2564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:58.935186 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:58.935781 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:58.935920 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:58.939217 (+ 3297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:58.939224 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:58.939225 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:58.939231 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:58.940698 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:58.941071 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:58.941074 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:58.941075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:58.941154 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:58.941351 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:58.941352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:58.941353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:58.941586 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:58.941662 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:58.941833 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 00:02:58.941991 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":81,"threads_started":1}
I20260812 00:02:58.942263 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:58.929525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:39455 (local address 127.0.0.1:52554)
0812 00:02:58.929701 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:58.929742 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:58.930354 (+ 612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:58.930622 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:58.930624 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:58.930884 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:58.931059 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:58.931062 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:58.934056 (+ 2994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:58.934058 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:58.935073 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:58.935078 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:58.935904 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:58.935906 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:58.936060 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:58.937187 (+ 1127us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:58.937196 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:58.939110 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:58.940790 (+ 1680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:58.940797 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:58.940800 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:58.940998 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:58.941213 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:58.941214 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:58.941214 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:58.941299 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:58.941651 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:58.941656 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:58.941722 (+ 66us) client_negotiation.cc:769] Sending connection context
0812 00:02:58.941803 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 00:02:58.942048 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":90,"thread_start_us":83,"threads_started":1}
I20260812 00:02:58.943286 15122 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:02:58.943708 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:58.943560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:44601 (local address 127.0.0.1:51466)
0812 00:02:58.943635 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:58.943684 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.125:44601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 00:02:58.943872 15042 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.103.125:44601: connect: Connection refused (error 111)
I20260812 00:02:58.944408 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:58.944268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:44601 (local address 127.0.0.1:51470)
0812 00:02:58.944331 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:58.944383 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.125:44601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.125@KRBTEST.COM" created.
W20260812 00:02:58.944527 15122 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.125:44601: Network error: Client connection negotiation failed: client connection to 127.25.103.125:44601: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.125.keytab.
Entry for principal kudu/127.25.103.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.125.keytab.
I20260812 00:02:58.960395 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.125:44601
--webserver_interface=127.25.103.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.125.keytab
--principal=kudu/127.25.103.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:38063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:39455,127.25.103.125:44601,127.25.103.124:44239
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:02:58.993774 15122 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } attempt: 1
I20260812 00:02:58.994376 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:58.994191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:44601 (local address 127.0.0.1:51476)
0812 00:02:58.994294 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:58.994341 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.125:44601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260812 00:02:58.994784 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:58.994644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:44601 (local address 127.0.0.1:51480)
0812 00:02:58.994718 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:58.994751 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.125:44601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 00:02:58.994896 15122 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.125:44601: Network error: Client connection negotiation failed: client connection to 127.25.103.125:44601: connect: Connection refused (error 111)
W20260812 00:02:59.047662 15138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:59.047907 15138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:59.047931 15138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:59.049186 15138 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:59.049227 15138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:59.049240 15138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:59.049252 15138 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:59.049263 15138 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:59.050879 15138 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:38063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:39455,127.25.103.125:44601,127.25.103.124:44239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.125.keytab
--principal=kudu/127.25.103.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.125:44601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.103.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:02:59.051122 15138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:59.051307 15138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:59.056121 15147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:59.056115 15144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:59.056113 15143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:59.056352 15138 server_base.cc:1034] running on GCE node
I20260812 00:02:59.056660 15138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:59.056970 15138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:59.058125 15138 hybrid_clock.cc:648] HybridClock initialized: now 1786492979058109 us; error 32 us; skew 500 ppm
Aug 12 00:02:59 dist-test-slave-vpvm krb5kdc[14979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492979, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:59.061089 15138 init.cc:377] Logged in from keytab as kudu/127.25.103.125@KRBTEST.COM (short username kudu)
I20260812 00:02:59.061586 15138 webserver.cc:460] Webserver started at http://127.25.103.125:34929/ using document root <none> and password file <none>
I20260812 00:02:59.061781 15138 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:59.061820 15138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:59.061908 15138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:59.062996 15138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-1/data/instance:
uuid: "c40b0229d67242d7b369b43a110d365f"
format_stamp: "Formatted at 2026-08-12 00:02:59 on dist-test-slave-vpvm"
server_key: "f7b1bf3537eae4024cd7279f4afc5baa"
server_key_iv: "85aad87cda7dd3268fcbd415620abcb1"
server_key_version: "encryptionkey@0"
I20260812 00:02:59.063050 15122 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } attempt: 2
I20260812 00:02:59.063350 15138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-1/wal/instance:
uuid: "c40b0229d67242d7b369b43a110d365f"
format_stamp: "Formatted at 2026-08-12 00:02:59 on dist-test-slave-vpvm"
server_key: "f7b1bf3537eae4024cd7279f4afc5baa"
server_key_iv: "85aad87cda7dd3268fcbd415620abcb1"
server_key_version: "encryptionkey@0"
I20260812 00:02:59.063551 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.063368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:44601 (local address 127.0.0.1:51482)
0812 00:02:59.063466 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.063511 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.125:44601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260812 00:02:59.063942 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.063801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:44601 (local address 127.0.0.1:51494)
0812 00:02:59.063879 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.063917 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.125:44601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 00:02:59.064119 15122 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.125:44601: Network error: Client connection negotiation failed: client connection to 127.25.103.125:44601: connect: Connection refused (error 111)
I20260812 00:02:59.064884 15138 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:02:59.065868 15159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:59.066192 15138 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:59.066286 15138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-1/wal
uuid: "c40b0229d67242d7b369b43a110d365f"
format_stamp: "Formatted at 2026-08-12 00:02:59 on dist-test-slave-vpvm"
server_key: "f7b1bf3537eae4024cd7279f4afc5baa"
server_key_iv: "85aad87cda7dd3268fcbd415620abcb1"
server_key_version: "encryptionkey@0"
I20260812 00:02:59.066354 15138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:59.088721 15138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:59.090977 15138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:59.091120 15138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:59.095480 15138 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.125:44601
I20260812 00:02:59.095520 15246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.125:44601 every 8 connection(s)
I20260812 00:02:59.095855 15138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-1/data/info.pb
I20260812 00:02:59.096560 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 15138
I20260812 00:02:59.096671 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-1/wal/instance
I20260812 00:02:59.096849 26013 external_mini_cluster.cc:1428] Setting key dd9b951f1dc0ce2866fd0db560d67180
I20260812 00:02:59.096930 15247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:59.098618 15247 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:02:59 dist-test-slave-vpvm krb5kdc[14979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492979, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.125@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.103.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.124@KRBTEST.COM" created.
I20260812 00:02:59.108448 15130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.099611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52560 (local address 127.25.103.126:39455)
0812 00:02:59.099661 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:59.099663 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:59.099743 (+ 80us) server_negotiation.cc:407] Connection header received
0812 00:02:59.100242 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:59.100244 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:59.100261 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:59.100343 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:59.101003 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.101749 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.102769 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.102983 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.103041 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.105345 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:59.105346 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:59.105347 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:59.105354 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:59.106840 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.107301 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.107302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.107303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.107369 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.107651 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.107653 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.107653 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.107803 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:59.107878 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:59.108296 (+ 418us) server_negotiation.cc:299] Negotiation successful
0812 00:02:59.108374 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:02:59.108675 15253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.099455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:39455 (local address 127.0.0.1:52560)
0812 00:02:59.099618 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.099659 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:59.100138 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:59.100413 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:59.100417 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:59.100664 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:59.100862 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:59.100866 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.101845 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.101846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:59.102684 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:59.102687 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.103054 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.103055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:59.103205 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.103675 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:59.103684 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:59.105210 (+ 1526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:59.106957 (+ 1747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:59.106965 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:59.106967 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:59.107201 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:59.107463 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:59.107464 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:59.107464 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:59.107587 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:59.107915 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:59.107925 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:59.108110 (+ 185us) client_negotiation.cc:769] Sending connection context
0812 00:02:59.108236 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 00:02:59.108422 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":85,"threads_started":1}
I20260812 00:02:59.109326 15247 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:02:59 dist-test-slave-vpvm krb5kdc[14979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492979, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.125@KRBTEST.COM for kudu/127.25.103.125@KRBTEST.COM
I20260812 00:02:59.117368 15253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.109618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:44601 (local address 127.0.0.1:51500)
0812 00:02:59.109682 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.109694 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:59.109740 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:59.110043 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:59.110044 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:59.110250 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:59.110311 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:59.110314 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.111424 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.111425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:59.111965 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:59.111967 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.112396 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.112397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:59.112460 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.112920 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:59.112925 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:59.114341 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:59.116168 (+ 1827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:59.116169 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:59.116169 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:59.116348 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:59.116611 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:59.116612 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:59.116613 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:59.116674 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:59.117065 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:59.117067 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:59.117113 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 00:02:59.117180 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 00:02:59.117271 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 00:02:59.117535 15257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.109726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51500 (local address 127.25.103.125:44601)
0812 00:02:59.109881 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:59.109885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:59.109907 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:02:59.109927 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:59.109929 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:59.109942 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:59.110030 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:59.110394 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.111285 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.112032 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.112336 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.112393 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.114420 (+ 2027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:59.114428 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:59.114428 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:59.114435 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:59.116078 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.116444 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.116446 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.116447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.116508 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.116769 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.116770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.116770 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.116974 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:59.117039 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:59.117239 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 00:02:59.117324 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":15,"server-negotiator.queue_time_us":126,"thread_start_us":84,"threads_started":1}
I20260812 00:02:59.118165 15247 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:02:59.118518 15253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.118380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:44239 (local address 127.0.0.1:34810)
0812 00:02:59.118421 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.118466 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:44239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 00:02:59.118670 15162 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.103.124:44239: connect: Connection refused (error 111)
I20260812 00:02:59.119158 15253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.118980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:44239 (local address 127.0.0.1:34816)
0812 00:02:59.119096 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.119132 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:44239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260812 00:02:59.119297 15247 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.124:44239: Network error: Client connection negotiation failed: client connection to 127.25.103.124:44239: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.124.keytab.
Entry for principal kudu/127.25.103.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.124.keytab.
I20260812 00:02:59.122975 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.124:44239
--webserver_interface=127.25.103.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.124.keytab
--principal=kudu/127.25.103.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:38063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:39455,127.25.103.125:44601,127.25.103.124:44239
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:02:59.155299 15122 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } attempt: 3
Aug 12 00:02:59 dist-test-slave-vpvm krb5kdc[14979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492978, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for kudu/127.25.103.125@KRBTEST.COM
I20260812 00:02:59.163203 15257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.155824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51516 (local address 127.25.103.125:44601)
0812 00:02:59.155883 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:59.155885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:59.155895 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:02:59.155963 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:59.155963 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:59.155972 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:59.156020 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:59.156428 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.157133 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.158209 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.158428 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.158490 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.160552 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:59.160554 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:59.160554 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:59.160563 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:59.162026 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.162433 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.162434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.162434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.162495 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.162718 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.162719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.162719 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.162846 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:59.162908 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:59.163054 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 00:02:59.163134 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:02:59.163249 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.155748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:44601 (local address 127.0.0.1:51516)
0812 00:02:59.155813 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.155828 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:59.155893 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:59.156036 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:59.156037 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:59.156230 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:59.156315 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:59.156317 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.157234 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.157235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:59.158107 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:59.158110 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.158497 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.158498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:59.158573 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.158999 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:59.159004 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:59.160444 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:59.162121 (+ 1677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:59.162122 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:59.162123 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:59.162346 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:59.162564 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:59.162565 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:59.162565 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:59.162630 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:59.162915 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:59.162916 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:59.162966 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 00:02:59.163034 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 00:02:59.163149 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 00:02:59.163669 15122 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:02:59.164044 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.163911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:44239 (local address 127.0.0.1:34832)
0812 00:02:59.163991 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.164022 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:44239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 00:02:59.164350 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.164259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:44239 (local address 127.0.0.1:34844)
0812 00:02:59.164301 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.164325 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:44239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 00:02:59.164428 15122 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.124:44239: Network error: Client connection negotiation failed: client connection to 127.25.103.124:44239: connect: Connection refused (error 111)
I20260812 00:02:59.168609 15247 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } attempt: 1
I20260812 00:02:59.169006 15253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.168896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:44239 (local address 127.0.0.1:34852)
0812 00:02:59.168947 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.168978 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:44239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 00:02:59.169294 15253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.169223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:44239 (local address 127.0.0.1:34860)
0812 00:02:59.169248 (+ 25us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.169272 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:44239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260812 00:02:59.169370 15247 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.124:44239: Network error: Client connection negotiation failed: client connection to 127.25.103.124:44239: connect: Connection refused (error 111)
I20260812 00:02:59.195581 15122 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } attempt: 1
I20260812 00:02:59.196131 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.195984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:44239 (local address 127.0.0.1:34868)
0812 00:02:59.196051 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.196094 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:44239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 00:02:59.196494 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.196374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:44239 (local address 127.0.0.1:34870)
0812 00:02:59.196436 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.196468 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:44239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 00:02:59.196606 15122 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.124:44239: Network error: Client connection negotiation failed: client connection to 127.25.103.124:44239: connect: Connection refused (error 111)
W20260812 00:02:59.209841 15259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:59.210124 15259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:59.210151 15259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:59.211369 15259 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:59.211421 15259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:59.211436 15259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:59.211447 15259 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:59.211458 15259 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:59.213001 15259 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:38063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:39455,127.25.103.125:44601,127.25.103.124:44239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.124.keytab
--principal=kudu/127.25.103.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.124:44239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.103.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:02:59.213244 15259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:59.213486 15259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:59.218638 15277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:59.218649 15268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:59.218659 15259 server_base.cc:1034] running on GCE node
W20260812 00:02:59.218629 15273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:59.219049 15259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:59.219349 15259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:59.220564 15259 hybrid_clock.cc:648] HybridClock initialized: now 1786492979220546 us; error 30 us; skew 500 ppm
Aug 12 00:02:59 dist-test-slave-vpvm krb5kdc[14979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492979, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:59.223196 15259 init.cc:377] Logged in from keytab as kudu/127.25.103.124@KRBTEST.COM (short username kudu)
I20260812 00:02:59.223670 15259 webserver.cc:460] Webserver started at http://127.25.103.124:35799/ using document root <none> and password file <none>
I20260812 00:02:59.223874 15259 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:59.223918 15259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:59.224037 15259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:59.225140 15259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-2/data/instance:
uuid: "fff75f1027804b21afb3f913347adf88"
format_stamp: "Formatted at 2026-08-12 00:02:59 on dist-test-slave-vpvm"
server_key: "7c26d6e62cf9a2a3fec008133e597ab6"
server_key_iv: "23c28f4471a7f76326b972e8951d16dd"
server_key_version: "encryptionkey@0"
I20260812 00:02:59.225472 15259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-2/wal/instance:
uuid: "fff75f1027804b21afb3f913347adf88"
format_stamp: "Formatted at 2026-08-12 00:02:59 on dist-test-slave-vpvm"
server_key: "7c26d6e62cf9a2a3fec008133e597ab6"
server_key_iv: "23c28f4471a7f76326b972e8951d16dd"
server_key_version: "encryptionkey@0"
I20260812 00:02:59.226883 15259 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:02:59.227763 15286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:59.228005 15259 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:59.228096 15259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-2/wal
uuid: "fff75f1027804b21afb3f913347adf88"
format_stamp: "Formatted at 2026-08-12 00:02:59 on dist-test-slave-vpvm"
server_key: "7c26d6e62cf9a2a3fec008133e597ab6"
server_key_iv: "23c28f4471a7f76326b972e8951d16dd"
server_key_version: "encryptionkey@0"
I20260812 00:02:59.228157 15259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:59.237522 15247 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } attempt: 2
I20260812 00:02:59.238008 15253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.237835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:44239 (local address 127.0.0.1:34882)
0812 00:02:59.237893 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.237940 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:44239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 00:02:59.238374 15253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.238299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:44239 (local address 127.0.0.1:34898)
0812 00:02:59.238333 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.238357 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:44239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260812 00:02:59.238610 15247 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.124:44239: Network error: Client connection negotiation failed: client connection to 127.25.103.124:44239: connect: Connection refused (error 111)
I20260812 00:02:59.242756 15259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:59.245012 15259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:59.245141 15259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:59.249778 15259 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.124:44239
I20260812 00:02:59.249857 15377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.124:44239 every 8 connection(s)
I20260812 00:02:59.250239 15259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-2/data/info.pb
I20260812 00:02:59.251291 15378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:59.253306 15378 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:02:59.258991 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 15259
I20260812 00:02:59.259124 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492802321514-26013-0/minicluster-data/master-2/wal/instance
I20260812 00:02:59.259330 26013 external_mini_cluster.cc:1428] Setting key 560cfccc06d38889d4ea22391473509c
Aug 12 00:02:59 dist-test-slave-vpvm krb5kdc[14979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492979, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.124@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:02:59.263971 15130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.254137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52568 (local address 127.25.103.126:39455)
0812 00:02:59.254183 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:59.254185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:59.254372 (+ 187us) server_negotiation.cc:407] Connection header received
0812 00:02:59.254865 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:59.254867 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:59.254880 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:59.254944 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:59.255592 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.256087 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.257059 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.257267 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.257326 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.259930 (+ 2604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:59.259931 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:59.259932 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:59.259941 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:59.262396 (+ 2455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.262902 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.262903 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.262903 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.262971 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.263245 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.263246 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.263247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.263387 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:59.263459 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:59.263802 (+ 343us) server_negotiation.cc:299] Negotiation successful
0812 00:02:59.263876 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:02:59.264343 15382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.254106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:39455 (local address 127.0.0.1:52568)
0812 00:02:59.254260 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.254297 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:59.254769 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:59.255014 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:59.255018 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:59.255280 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:59.255504 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:59.255508 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.256169 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.256170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:59.256976 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:59.256978 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.257340 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.257340 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:59.257595 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.258125 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:59.258134 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:59.259783 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:59.262481 (+ 2698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:59.262489 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:59.262492 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:59.262807 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:59.263046 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:59.263046 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:59.263047 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:59.263185 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:59.263484 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:59.263492 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:59.263643 (+ 151us) client_negotiation.cc:769] Sending connection context
0812 00:02:59.263783 (+ 140us) client_negotiation.cc:240] Negotiation successful
0812 00:02:59.263962 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":75,"threads_started":1}
I20260812 00:02:59.264979 15378 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:02:59 dist-test-slave-vpvm krb5kdc[14979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.124@KRBTEST.COM
Aug 12 00:02:59 dist-test-slave-vpvm krb5kdc[14979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492979, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.124@KRBTEST.COM for kudu/127.25.103.125@KRBTEST.COM
I20260812 00:02:59.269726 15387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.259738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34914 (local address 127.25.103.124:44239)
0812 00:02:59.259899 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:59.259904 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:59.259949 (+ 45us) server_negotiation.cc:407] Connection header received
0812 00:02:59.260018 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:59.260021 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:59.260036 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:59.260126 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:59.261019 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.262130 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.263100 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.263542 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.263593 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.266280 (+ 2687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:59.266288 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:59.266288 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:59.266295 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:59.268111 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.268547 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.268550 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.268550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.268606 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.268851 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.268852 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.268852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.269005 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:59.269167 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:59.269535 (+ 368us) server_negotiation.cc:299] Negotiation successful
0812 00:02:59.269623 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":71,"threads_started":1}
I20260812 00:02:59.271752 15122 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } attempt: 2
I20260812 00:02:59.272996 15257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.265307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51530 (local address 127.25.103.125:44601)
0812 00:02:59.265381 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:59.265383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:59.265392 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:02:59.265417 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:59.265419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:59.265429 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:59.265481 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:59.265743 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.266319 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.266956 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.267229 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.267313 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.269592 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:59.269594 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:59.269594 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:59.269601 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:59.271309 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.272021 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.272022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.272023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.272092 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.272346 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.272347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.272347 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.272493 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:59.272556 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:59.272819 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 00:02:59.272906 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 00:02:59.273336 15382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.265225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:44601 (local address 127.0.0.1:51530)
0812 00:02:59.265267 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.265279 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:59.265319 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:59.265494 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:59.265494 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:59.265609 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:59.265661 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:59.265662 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.266392 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.266393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:59.266879 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:59.266880 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.267418 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.267419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:59.267497 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.267853 (+ 356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:59.267856 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:59.269435 (+ 1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:59.271524 (+ 2089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:59.271526 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:59.271526 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:59.271789 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:59.272197 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:59.272198 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:59.272198 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:59.272258 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:59.272603 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:59.272603 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:59.272655 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 00:02:59.273136 (+ 481us) client_negotiation.cc:240] Negotiation successful
0812 00:02:59.273241 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260812 00:02:59.274133 15378 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:02:59 dist-test-slave-vpvm krb5kdc[14979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
Aug 12 00:02:59 dist-test-slave-vpvm krb5kdc[14979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492978, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for kudu/127.25.103.124@KRBTEST.COM
Aug 12 00:02:59 dist-test-slave-vpvm krb5kdc[14979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492979, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.124@KRBTEST.COM for kudu/127.25.103.124@KRBTEST.COM
I20260812 00:02:59.280346 15130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.270766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52576 (local address 127.25.103.126:39455)
0812 00:02:59.270810 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:59.270812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:59.270867 (+ 55us) server_negotiation.cc:407] Connection header received
0812 00:02:59.270949 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:59.270950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:59.270959 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:59.271007 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:59.271591 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.272524 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.273913 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.274208 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.274264 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.277217 (+ 2953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:59.277219 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:59.277219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:59.277226 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:59.279050 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.279452 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.279453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.279454 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.279503 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.279834 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.279835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.279835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.279961 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:59.280131 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:59.280169 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 00:02:59.280247 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:02:59.280807 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.272069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:44239 (local address 127.0.0.1:34920)
0812 00:02:59.272111 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.272123 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:59.272164 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:59.272297 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:59.272298 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:59.272440 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:59.272475 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:59.272477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.273445 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.273446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:59.274313 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:59.274316 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.274941 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.274943 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:59.275004 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.275373 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:59.275378 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:59.277081 (+ 1703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:59.279408 (+ 2327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:59.279409 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:59.279409 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:59.279625 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:59.279789 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:59.279790 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:59.279790 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:59.279846 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:59.280319 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:59.280320 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:59.280364 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 00:02:59.280492 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 00:02:59.280711 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 00:02:59.281217 15387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.272117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34920 (local address 127.25.103.124:44239)
0812 00:02:59.272164 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:59.272166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:59.272174 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:59.272217 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:59.272218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:59.272228 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:59.272275 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:59.272542 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.273331 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.274390 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.274875 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.274942 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.277242 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:59.277243 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:59.277244 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:59.277251 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:59.279341 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.279685 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.279686 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.279686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.279737 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.279900 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.279902 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.279902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.280233 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:59.280936 (+ 703us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:59.280988 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 00:02:59.281132 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:02:59.282078 15382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.274523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:44239 (local address 127.0.0.1:34922)
0812 00:02:59.274586 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.274597 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:59.274641 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:59.274874 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:59.274875 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:59.275030 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:59.275064 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:59.275066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.276021 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.276022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:59.276743 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:59.276746 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.277201 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.277202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:59.277246 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.277592 (+ 346us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:59.277596 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:59.279035 (+ 1439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:59.280885 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:59.280885 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:59.280886 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:59.281246 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:59.281445 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:59.281446 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:59.281447 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:59.281521 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:59.281821 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:59.281822 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:59.281856 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 00:02:59.281895 (+ 39us) client_negotiation.cc:240] Negotiation successful
0812 00:02:59.282013 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 00:02:59.282454 15388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.274642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34922 (local address 127.25.103.124:44239)
0812 00:02:59.274786 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:59.274787 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:59.274792 (+ 5us) server_negotiation.cc:407] Connection header received
0812 00:02:59.274803 (+ 11us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:59.274803 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:59.274810 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:59.274860 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:59.275152 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.275929 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.276828 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.277128 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.277375 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.279129 (+ 1754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:59.279131 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:59.279131 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:59.279138 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:59.280801 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.281312 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.281312 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.281313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.281371 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.281581 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.281582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.281582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.281752 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:59.282251 (+ 499us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:59.282288 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 00:02:59.282361 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
I20260812 00:02:59.282913 15122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597: Bootstrap starting.
I20260812 00:02:59.283684 15122 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:59.284013 15122 log.cc:824] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:59.284889 15122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597: No bootstrap required, opened a new log
Aug 12 00:02:59 dist-test-slave-vpvm krb5kdc[14979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.125@KRBTEST.COM
I20260812 00:02:59.285768 15378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88: Bootstrap starting.
I20260812 00:02:59.286523 15378 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:59.286805 15378 log.cc:824] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:59.287067 15122 raft_consensus.cc:348] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } }
I20260812 00:02:59.287226 15122 raft_consensus.cc:374] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:59.287278 15122 raft_consensus.cc:729] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef7142db6834dd0a120c2295df2c597, State: Initialized, Role: FOLLOWER
I20260812 00:02:59.287412 15122 consensus_queue.cc:260] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } }
I20260812 00:02:59.287761 15122 sys_catalog.cc:564] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:59.287739 15391 sys_catalog.cc:455] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } } }
I20260812 00:02:59.287885 15378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88: No bootstrap required, opened a new log
I20260812 00:02:59.287992 15391 sys_catalog.cc:458] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:02:59.289749 15257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.281154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51546 (local address 127.25.103.125:44601)
0812 00:02:59.281195 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:59.281197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:59.281205 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:59.281273 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:59.281274 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:59.281284 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:59.281313 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:59.281975 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.282639 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.283340 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.283615 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.283704 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.286301 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:59.286303 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:59.286303 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:59.286312 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:59.288096 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.288597 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.288598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.288599 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.288672 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.288903 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.288904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.288904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.289139 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:59.289322 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:59.289580 (+ 258us) server_negotiation.cc:299] Negotiation successful
0812 00:02:59.289663 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 00:02:59.290047 15419 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:02:59.290102 15419 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:02:59.291404 15378 raft_consensus.cc:348] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } }
I20260812 00:02:59.291594 15378 raft_consensus.cc:374] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:59.291635 15378 raft_consensus.cc:729] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fff75f1027804b21afb3f913347adf88, State: Initialized, Role: FOLLOWER
I20260812 00:02:59.291764 15378 consensus_queue.cc:260] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } }
I20260812 00:02:59.292117 15378 sys_catalog.cc:564] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 00:02:59.294941 15448 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:02:59.298317 15448 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:02:59.298578 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:02:59.300191 15259 master_runner.cc:186] Error getting master registration for 127.25.103.125:44601: OK, instance_id { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" instance_seqno: 1786492979094258 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:02:59.302570 15259 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:02:59.293228 15010 master_runner.cc:186] Error getting master registration for 127.25.103.125:44601: OK, instance_id { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" instance_seqno: 1786492979094258 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:02:59.303112 15010 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:02:59.303887 15421 sys_catalog.cc:455] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } } }
I20260812 00:02:59.303989 15421 sys_catalog.cc:458] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:02:59.314738 15388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.300168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34930 (local address 127.25.103.124:44239)
0812 00:02:59.302049 (+ 1881us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:59.302051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:59.302170 (+ 119us) server_negotiation.cc:407] Connection header received
0812 00:02:59.302268 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:59.302269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:59.302278 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:59.302306 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:59.303532 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.304313 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.305476 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.305819 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.305898 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.307473 (+ 1575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:59.307475 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:59.307475 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:59.307615 (+ 140us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:59.312089 (+ 4474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.312657 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.312658 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.312659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.312722 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.313136 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.313137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.313138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.313306 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:59.313766 (+ 460us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:59.314530 (+ 764us) server_negotiation.cc:299] Negotiation successful
0812 00:02:59.314623 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1855}
I20260812 00:02:59.318115 15257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.303655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51550 (local address 127.25.103.125:44601)
0812 00:02:59.304398 (+ 743us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:59.304400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:59.310415 (+ 6015us) server_negotiation.cc:407] Connection header received
0812 00:02:59.310529 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:59.310531 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:59.310543 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:59.310574 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:59.311124 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.311831 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.312740 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.312998 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.313035 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.314798 (+ 1763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:59.314799 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:59.314800 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:59.314808 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:59.316791 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.317172 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.317174 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.317174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.317246 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.317534 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.317535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.317535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.317679 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:59.317773 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:59.317885 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 00:02:59.318014 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":717}
I20260812 00:02:59.325805 15130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.303413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52588 (local address 127.25.103.126:39455)
0812 00:02:59.303478 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:59.303480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:59.310138 (+ 6658us) server_negotiation.cc:407] Connection header received
0812 00:02:59.310187 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:59.310188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:59.310199 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:59.310256 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:59.310844 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.311586 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.312573 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.312847 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.312883 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.322798 (+ 9915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:59.322800 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:59.322801 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:59.322810 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:59.324567 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.324985 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.324986 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.324987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.325051 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.325241 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.325241 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.325242 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.325387 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:59.325482 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:59.325619 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 00:02:59.325707 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:02:59.329774 15247 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } attempt: 3
Aug 12 00:02:59 dist-test-slave-vpvm krb5kdc[14979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492979, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.125@KRBTEST.COM for kudu/127.25.103.124@KRBTEST.COM
I20260812 00:02:59.340648 15388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.330280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34944 (local address 127.25.103.124:44239)
0812 00:02:59.330569 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:59.330571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:59.330579 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:59.330600 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:59.330601 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:59.330611 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:59.330668 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:59.331011 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.331902 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.332935 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.333253 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.333463 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.336187 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:59.336188 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:59.336189 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:59.336197 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:59.338400 (+ 2203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.339089 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.339090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.339090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.339153 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:59.340057 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:59.340058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:59.340058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:59.340215 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:59.340290 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:59.340456 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 00:02:59.340547 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264}
I20260812 00:02:59.340655 15253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:59.330117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:44239 (local address 127.0.0.1:34944)
0812 00:02:59.330168 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:59.330181 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:59.330232 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:59.330687 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:59.330689 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:59.330868 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:59.330932 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:59.330934 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.332001 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.332002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:59.332836 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:59.332839 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:59.333458 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:59.333459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:59.333520 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:59.334279 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:59.334284 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:59.336107 (+ 1823us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:59.338510 (+ 2403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:59.338511 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:59.338512 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:59.338975 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:59.339901 (+ 926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:59.339902 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:59.339902 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:59.339987 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:59.340290 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:59.340291 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:59.340346 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 00:02:59.340418 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 00:02:59.340541 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 00:02:59.343073 15247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f: Bootstrap starting.
I20260812 00:02:59.343868 15247 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:59.344341 15247 log.cc:824] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:59.345321 15247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f: No bootstrap required, opened a new log
I20260812 00:02:59.347575 15247 raft_consensus.cc:348] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } }
I20260812 00:02:59.347760 15247 raft_consensus.cc:374] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:59.347796 15247 raft_consensus.cc:729] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c40b0229d67242d7b369b43a110d365f, State: Initialized, Role: FOLLOWER
I20260812 00:02:59.347965 15247 consensus_queue.cc:260] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } }
I20260812 00:02:59.348313 15247 sys_catalog.cc:564] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f [sys.catalog]: configured and running, proceeding with master startup.
W20260812 00:02:59.352176 15478 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:02:59.352238 15478 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:02:59.352540 15463 sys_catalog.cc:455] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } } }
I20260812 00:02:59.352602 15463 sys_catalog.cc:458] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:02:59.353077 15138 master_runner.cc:263] No leader master found from master c40b0229d67242d7b369b43a110d365f
I20260812 00:02:59.353116 15138 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:02:59.353186 15391 raft_consensus.cc:482] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:02:59.353276 15391 raft_consensus.cc:504] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } }
I20260812 00:02:59.353506 15391 leader_election.cc:288] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c40b0229d67242d7b369b43a110d365f (127.25.103.125:44601), fff75f1027804b21afb3f913347adf88 (127.25.103.124:44239)
I20260812 00:02:59.353814 15204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fef7142db6834dd0a120c2295df2c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c40b0229d67242d7b369b43a110d365f" is_pre_election: true
I20260812 00:02:59.353976 15204 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fef7142db6834dd0a120c2295df2c597 in term 0.
I20260812 00:02:59.354139 15042 leader_election.cc:302] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c40b0229d67242d7b369b43a110d365f, fef7142db6834dd0a120c2295df2c597; no voters:
I20260812 00:02:59.354269 15391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:02:59.354305 15391 raft_consensus.cc:482] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:02:59.354337 15391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:59.355275 15391 raft_consensus.cc:504] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } }
I20260812 00:02:59.355409 15391 leader_election.cc:288] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [CANDIDATE]: Term 1 election: Requested vote from peers c40b0229d67242d7b369b43a110d365f (127.25.103.125:44601), fff75f1027804b21afb3f913347adf88 (127.25.103.124:44239)
I20260812 00:02:59.355222 15333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fef7142db6834dd0a120c2295df2c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fff75f1027804b21afb3f913347adf88" is_pre_election: true
I20260812 00:02:59.355552 15333 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fef7142db6834dd0a120c2295df2c597 in term 0.
I20260812 00:02:59.355695 15204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fef7142db6834dd0a120c2295df2c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c40b0229d67242d7b369b43a110d365f"
I20260812 00:02:59.355762 15204 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:59.355623 15332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fef7142db6834dd0a120c2295df2c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fff75f1027804b21afb3f913347adf88"
I20260812 00:02:59.356367 15332 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:59.356705 15204 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fef7142db6834dd0a120c2295df2c597 in term 1.
I20260812 00:02:59.356877 15042 leader_election.cc:302] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c40b0229d67242d7b369b43a110d365f, fef7142db6834dd0a120c2295df2c597; no voters:
I20260812 00:02:59.356977 15391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:59.357142 15391 raft_consensus.cc:686] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [term 1 LEADER]: Becoming Leader. State: Replica: fef7142db6834dd0a120c2295df2c597, State: Running, Role: LEADER
I20260812 00:02:59.357275 15332 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fef7142db6834dd0a120c2295df2c597 in term 1.
I20260812 00:02:59.357278 15391 consensus_queue.cc:237] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } }
I20260812 00:02:59.357802 15481 sys_catalog.cc:455] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fef7142db6834dd0a120c2295df2c597. Latest consensus state: current_term: 1 leader_uuid: "fef7142db6834dd0a120c2295df2c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } } }
I20260812 00:02:59.359042 15481 sys_catalog.cc:458] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:59.359391 15486 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:02:59.359706 15486 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:02:59.361815 15332 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88 [term 1 FOLLOWER]: Refusing update from remote peer fef7142db6834dd0a120c2295df2c597: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:59.361802 15204 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f [term 1 FOLLOWER]: Refusing update from remote peer fef7142db6834dd0a120c2295df2c597: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:59.362274 15481 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:59.362457 15391 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:59.363801 15421 sys_catalog.cc:455] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fef7142db6834dd0a120c2295df2c597. Latest consensus state: current_term: 1 leader_uuid: "fef7142db6834dd0a120c2295df2c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } } }
I20260812 00:02:59.363797 15463 sys_catalog.cc:455] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f [sys.catalog]: SysCatalogTable state changed. Reason: New leader fef7142db6834dd0a120c2295df2c597. Latest consensus state: current_term: 1 leader_uuid: "fef7142db6834dd0a120c2295df2c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } } }
I20260812 00:02:59.363910 15463 sys_catalog.cc:458] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:02:59.363910 15421 sys_catalog.cc:458] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:02:59.364907 15391 sys_catalog.cc:455] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fef7142db6834dd0a120c2295df2c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } } }
I20260812 00:02:59.364991 15391 sys_catalog.cc:458] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:59.365026 15391 sys_catalog.cc:455] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fef7142db6834dd0a120c2295df2c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } } }
I20260812 00:02:59.365061 15391 sys_catalog.cc:458] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:59.365315 15421 sys_catalog.cc:455] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fef7142db6834dd0a120c2295df2c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } } }
I20260812 00:02:59.365394 15421 sys_catalog.cc:458] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:02:59.365384 15463 sys_catalog.cc:455] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fef7142db6834dd0a120c2295df2c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef7142db6834dd0a120c2295df2c597" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39455 } } peers { permanent_uuid: "c40b0229d67242d7b369b43a110d365f" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 44601 } } peers { permanent_uuid: "fff75f1027804b21afb3f913347adf88" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 44239 } } }
I20260812 00:02:59.365469 15463 sys_catalog.cc:458] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:02:59.365688 15488 mvcc.cc:205] Tried to move back new op lower bound from 7317475243462320128 to 7317475243448078336. Current Snapshot: MvccSnapshot[applied={T|T < 7317475243462320128}]
I20260812 00:02:59.365760 15487 mvcc.cc:205] Tried to move back new op lower bound from 7317475243462320128 to 7317475243448078336. Current Snapshot: MvccSnapshot[applied={T|T < 7317475243462320128}]
I20260812 00:02:59.366305 15489 mvcc.cc:205] Tried to move back new op lower bound from 7317475243462320128 to 7317475243448078336. Current Snapshot: MvccSnapshot[applied={T|T < 7317475243462320128}]
I20260812 00:02:59.366356 15486 catalog_manager.cc:1347] Generated new cluster ID: 39c80ca4291a436593a6543e0b9890bb
I20260812 00:02:59.366397 15486 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:02:59.397975 15486 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:02:59.399062 15486 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:59.410624 15486 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fef7142db6834dd0a120c2295df2c597: Generated new TSK 0
I20260812 00:02:59.411037 15486 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:03:00.298969 15448 catalog_manager.cc:1259] Loaded cluster ID: 39c80ca4291a436593a6543e0b9890bb
I20260812 00:03:00.299063 15448 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88: loading cluster ID for follower catalog manager: success
I20260812 00:03:00.299961 15448 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88: acquiring CA information for follower catalog manager: success
I20260812 00:03:00.300280 15448 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fff75f1027804b21afb3f913347adf88: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:03:00.353029 15478 catalog_manager.cc:1259] Loaded cluster ID: 39c80ca4291a436593a6543e0b9890bb
I20260812 00:03:00.353152 15478 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f: loading cluster ID for follower catalog manager: success
I20260812 00:03:00.354135 15478 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f: acquiring CA information for follower catalog manager: success
I20260812 00:03:00.354625 15478 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c40b0229d67242d7b369b43a110d365f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:03:00.475720 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 15010
I20260812 00:03:00.492971 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 15138
I20260812 00:03:00.508723 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 15259
2026-08-12T00:03:00Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3093 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:03:00 dist-test-slave-vpvm krb5kdc[15523](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:03:00 dist-test-slave-vpvm krb5kdc[15523](info): set up 2 sockets
Aug 12 00:03:00 dist-test-slave-vpvm krb5kdc[15523](info): commencing operation
krb5kdc: starting...
W20260812 00:03:01.768107 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:03:01 dist-test-slave-vpvm krb5kdc[15523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:03:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:03:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:03:01.914464 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:36165
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:45001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:36165
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:03:02.014282 15553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:02.014586 15553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:02.014631 15553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:02.016104 15553 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:03:02.016176 15553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:02.016201 15553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:02.016222 15553 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:03:02.016242 15553 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:03:02.018128 15553 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:45001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:36165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:36165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:02.018460 15553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:02.018728 15553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:02.024474 15563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:02.024478 15567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:02.024505 15565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:02.025718 15553 server_base.cc:1034] running on GCE node
I20260812 00:03:02.026044 15553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:02.026403 15553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:02.027680 15553 hybrid_clock.cc:648] HybridClock initialized: now 1786492982027638 us; error 40 us; skew 500 ppm
Aug 12 00:03:02 dist-test-slave-vpvm krb5kdc[15523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492982, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:02.031773 15553 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:03:02.032509 15553 webserver.cc:460] Webserver started at http://127.25.103.126:37333/ using document root <none> and password file <none>
I20260812 00:03:02.032800 15553 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:02.032855 15553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:02.033006 15553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:03:02.034415 15553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "e0b2e589a6d54fbb97ad4ed32d052e7f"
format_stamp: "Formatted at 2026-08-12 00:03:02 on dist-test-slave-vpvm"
server_key: "3ac3e7d83dd9cd7f5a23ded827ca8234"
server_key_iv: "256da33ebb7b01c04045b01b8e4818ab"
server_key_version: "encryptionkey@0"
I20260812 00:03:02.034829 15553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "e0b2e589a6d54fbb97ad4ed32d052e7f"
format_stamp: "Formatted at 2026-08-12 00:03:02 on dist-test-slave-vpvm"
server_key: "3ac3e7d83dd9cd7f5a23ded827ca8234"
server_key_iv: "256da33ebb7b01c04045b01b8e4818ab"
server_key_version: "encryptionkey@0"
I20260812 00:03:02.036509 15553 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 00:03:02.037520 15577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:02.037890 15553 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:02.038105 15553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "e0b2e589a6d54fbb97ad4ed32d052e7f"
format_stamp: "Formatted at 2026-08-12 00:03:02 on dist-test-slave-vpvm"
server_key: "3ac3e7d83dd9cd7f5a23ded827ca8234"
server_key_iv: "256da33ebb7b01c04045b01b8e4818ab"
server_key_version: "encryptionkey@0"
I20260812 00:03:02.038216 15553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:02.058441 15553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:02.066059 15553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:02.066265 15553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:02.074059 15553 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:36165
I20260812 00:03:02.074173 15673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:36165 every 8 connection(s)
I20260812 00:03:02.074774 15553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:03:02.076160 15674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:02.081274 15674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f: Bootstrap starting.
I20260812 00:03:02.082255 15674 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:02.082629 15674 log.cc:824] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:02.083148 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 15553
I20260812 00:03:02.083238 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:03:02.083437 26013 external_mini_cluster.cc:1428] Setting key 10e9cdf217f3e7557009f4f20de0a81e
I20260812 00:03:02.084039 15674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f: No bootstrap required, opened a new log
I20260812 00:03:02.086285 15674 raft_consensus.cc:348] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0b2e589a6d54fbb97ad4ed32d052e7f" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36165 } }
I20260812 00:03:02.086462 15674 raft_consensus.cc:374] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:02.086483 15674 raft_consensus.cc:729] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b2e589a6d54fbb97ad4ed32d052e7f, State: Initialized, Role: FOLLOWER
I20260812 00:03:02.086618 15674 consensus_queue.cc:260] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0b2e589a6d54fbb97ad4ed32d052e7f" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36165 } }
I20260812 00:03:02.086673 15674 raft_consensus.cc:388] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:03:02.086694 15674 raft_consensus.cc:482] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:03:02.086720 15674 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:03:02.087862 15674 raft_consensus.cc:504] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0b2e589a6d54fbb97ad4ed32d052e7f" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36165 } }
I20260812 00:03:02.087987 15674 leader_election.cc:302] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e0b2e589a6d54fbb97ad4ed32d052e7f; no voters:
I20260812 00:03:02.090397 15674 leader_election.cc:288] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:03:02.090437 15683 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:03:02.090655 15683 raft_consensus.cc:686] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f [term 1 LEADER]: Becoming Leader. State: Replica: e0b2e589a6d54fbb97ad4ed32d052e7f, State: Running, Role: LEADER
I20260812 00:03:02.090785 15683 consensus_queue.cc:237] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0b2e589a6d54fbb97ad4ed32d052e7f" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36165 } }
I20260812 00:03:02.090951 15674 sys_catalog.cc:564] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:03:02.091331 15684 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e0b2e589a6d54fbb97ad4ed32d052e7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0b2e589a6d54fbb97ad4ed32d052e7f" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36165 } } }
I20260812 00:03:02.091538 15684 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f [sys.catalog]: This master's current role is: LEADER
I20260812 00:03:02.092222 15685 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e0b2e589a6d54fbb97ad4ed32d052e7f. Latest consensus state: current_term: 1 leader_uuid: "e0b2e589a6d54fbb97ad4ed32d052e7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0b2e589a6d54fbb97ad4ed32d052e7f" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36165 } } }
I20260812 00:03:02.092346 15685 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f [sys.catalog]: This master's current role is: LEADER
W20260812 00:03:02.093717 15712 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:03:02.093783 15712 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:03:02.093838 15692 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:03:02.094074 15692 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 00:03:02 dist-test-slave-vpvm krb5kdc[15523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:03:02.096828 15692 catalog_manager.cc:1347] Generated new cluster ID: f750590979844d878a435cec036f72c7
I20260812 00:03:02.096932 15692 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:03:02.104279 15680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:02.084254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46550 (local address 127.25.103.126:36165)
0812 00:03:02.084456 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:02.084467 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:02.084503 (+ 36us) server_negotiation.cc:407] Connection header received
0812 00:03:02.087332 (+ 2829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:02.087347 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:02.087443 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:02.087601 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:02.089177 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:02.091493 (+ 2316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:02.092589 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:02.093249 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:02.093362 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:02.097099 (+ 3737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:02.097105 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:02.097105 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:02.097122 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:02.101588 (+ 4466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:02.102203 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:02.102208 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:02.102209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:02.102411 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:02.102644 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:02.102646 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:02.102646 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:02.103066 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:02.103290 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:02.103844 (+ 554us) server_negotiation.cc:299] Negotiation successful
0812 00:03:02.104029 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":111,"threads_started":1}
I20260812 00:03:02.104358 15692 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:03:02.105288 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:03:02.105734 15692 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:03:02.115100 15692 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e0b2e589a6d54fbb97ad4ed32d052e7f: Generated new TSK 0
I20260812 00:03:02.115374 15692 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:03:02.161115 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 15553
2026-08-12T00:03:02Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1655 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:03:02 dist-test-slave-vpvm krb5kdc[15732](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:03:02 dist-test-slave-vpvm krb5kdc[15732](info): set up 2 sockets
Aug 12 00:03:02 dist-test-slave-vpvm krb5kdc[15732](info): commencing operation
krb5kdc: starting...
W20260812 00:03:03.408430 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:03:03 dist-test-slave-vpvm krb5kdc[15732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492983, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:03:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:03:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:03:03.549986 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:42771
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:42771
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:03:03.653668 15755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:03.653918 15755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:03.653981 15755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:03.655220 15755 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:03:03.655267 15755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:03.655285 15755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:03.655301 15755 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:03:03.655318 15755 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:03:03.656929 15755 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:42771
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:42771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:03.657199 15755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:03.657425 15755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:03.662591 15764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:03.662595 15762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:03.662595 15767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:03.662617 15755 server_base.cc:1034] running on GCE node
I20260812 00:03:03.663128 15755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:03.663437 15755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:03.664605 15755 hybrid_clock.cc:648] HybridClock initialized: now 1786492983664591 us; error 34 us; skew 500 ppm
Aug 12 00:03:03 dist-test-slave-vpvm krb5kdc[15732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492983, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:03.671562 15755 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:03:03.672087 15755 webserver.cc:460] Webserver started at http://127.25.103.126:44637/ using document root <none> and password file <none>
I20260812 00:03:03.672307 15755 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:03.672359 15755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:03.672497 15755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:03:03.673635 15755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "f7c7742675c14024b02710088a902e78"
format_stamp: "Formatted at 2026-08-12 00:03:03 on dist-test-slave-vpvm"
server_key: "3eb2d26c4732dac8eb0d8d31c5a58a07"
server_key_iv: "6547a33835e52cdf9a64f28d8b2f5768"
server_key_version: "encryptionkey@0"
I20260812 00:03:03.674049 15755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "f7c7742675c14024b02710088a902e78"
format_stamp: "Formatted at 2026-08-12 00:03:03 on dist-test-slave-vpvm"
server_key: "3eb2d26c4732dac8eb0d8d31c5a58a07"
server_key_iv: "6547a33835e52cdf9a64f28d8b2f5768"
server_key_version: "encryptionkey@0"
I20260812 00:03:03.675489 15755 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:03:03.676391 15779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:03.676589 15755 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:03:03.676766 15755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "f7c7742675c14024b02710088a902e78"
format_stamp: "Formatted at 2026-08-12 00:03:03 on dist-test-slave-vpvm"
server_key: "3eb2d26c4732dac8eb0d8d31c5a58a07"
server_key_iv: "6547a33835e52cdf9a64f28d8b2f5768"
server_key_version: "encryptionkey@0"
I20260812 00:03:03.676859 15755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:03.697765 15755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:03.700486 15755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:03.700656 15755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:03.705067 15755 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:42771
I20260812 00:03:03.705106 15878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:42771 every 8 connection(s)
I20260812 00:03:03.705642 15755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:03:03.706739 15879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:03.707137 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 15755
I20260812 00:03:03.707237 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:03:03.707429 26013 external_mini_cluster.cc:1428] Setting key 1498f8466d18f0e2c127a71bef8fa02d
I20260812 00:03:03.709828 15879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78: Bootstrap starting.
I20260812 00:03:03.711014 15879 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:03.711515 15879 log.cc:824] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:03.712966 15879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78: No bootstrap required, opened a new log
Aug 12 00:03:03 dist-test-slave-vpvm krb5kdc[15732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492983, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:03:03.716902 15879 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c7742675c14024b02710088a902e78" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42771 } }
I20260812 00:03:03.717080 15879 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:03.717103 15879 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c7742675c14024b02710088a902e78, State: Initialized, Role: FOLLOWER
I20260812 00:03:03.717219 15879 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c7742675c14024b02710088a902e78" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42771 } }
I20260812 00:03:03.717298 15879 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:03:03.717324 15879 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:03:03.717363 15879 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:03:03.718150 15879 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c7742675c14024b02710088a902e78" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42771 } }
I20260812 00:03:03.718261 15879 leader_election.cc:302] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7c7742675c14024b02710088a902e78; no voters:
I20260812 00:03:03.718446 15879 leader_election.cc:288] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:03:03.718528 15888 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:03:03.718626 15884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:03.708072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54068 (local address 127.25.103.126:42771)
0812 00:03:03.708235 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:03.708243 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:03.708269 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:03:03.708809 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:03.708817 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:03.708874 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:03.709018 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:03.709648 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:03.710606 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:03.711433 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:03.711878 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:03.711977 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:03.715126 (+ 3149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:03.715132 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:03.715132 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:03.715146 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:03.716882 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:03.717274 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:03.717277 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:03.717278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:03.717390 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:03.717661 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:03.717662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:03.717662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:03.717924 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:03.718132 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:03.718249 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 00:03:03.718394 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":76,"threads_started":1}
I20260812 00:03:03.718652 15888 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 1 LEADER]: Becoming Leader. State: Replica: f7c7742675c14024b02710088a902e78, State: Running, Role: LEADER
I20260812 00:03:03.718741 15879 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:03:03.718765 15888 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c7742675c14024b02710088a902e78" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42771 } }
I20260812 00:03:03.719130 15889 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7c7742675c14024b02710088a902e78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c7742675c14024b02710088a902e78" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42771 } } }
I20260812 00:03:03.719216 15889 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [sys.catalog]: This master's current role is: LEADER
I20260812 00:03:03.719384 15890 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7c7742675c14024b02710088a902e78. Latest consensus state: current_term: 1 leader_uuid: "f7c7742675c14024b02710088a902e78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c7742675c14024b02710088a902e78" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42771 } } }
I20260812 00:03:03.719444 15890 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [sys.catalog]: This master's current role is: LEADER
I20260812 00:03:03.719574 15898 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:03:03.720110 15898 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:03:03.721877 15898 catalog_manager.cc:1347] Generated new cluster ID: c72639eda8aa4fe2807d5ec70ebff153
I20260812 00:03:03.721931 15898 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:03:03.760536 15898 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:03:03.761116 15898 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:03:03.774340 15898 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78: Generated new TSK 0
I20260812 00:03:03.774570 15898 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
I20260812 00:03:03.817680 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42771
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:03:03.936775 15924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:03.937101 15924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:03.937155 15924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:03.938725 15924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:03.938791 15924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:03.938820 15924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:03:03.940589 15924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42771
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:03.940871 15924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:03.941131 15924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:03.946244 15934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:03.946244 15941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:03.946249 15935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:03.946445 15924 server_base.cc:1034] running on GCE node
I20260812 00:03:03.946758 15924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:03.947105 15924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:03.948285 15924 hybrid_clock.cc:648] HybridClock initialized: now 1786492983948272 us; error 30 us; skew 500 ppm
Aug 12 00:03:03 dist-test-slave-vpvm krb5kdc[15732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492983, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:03.951359 15924 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:03:03.951960 15924 webserver.cc:460] Webserver started at http://127.25.103.65:44369/ using document root <none> and password file <none>
I20260812 00:03:03.952275 15924 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:03.952335 15924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:03.952584 15924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:03:03.953748 15924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "4f3bab7efac44dea914aecf2a7422317"
format_stamp: "Formatted at 2026-08-12 00:03:03 on dist-test-slave-vpvm"
server_key: "e3904a53219ef8960c2b6d7e6e82ee62"
server_key_iv: "03573be08b5d2ebdb5418f012ec754ab"
server_key_version: "encryptionkey@0"
I20260812 00:03:03.954363 15924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "4f3bab7efac44dea914aecf2a7422317"
format_stamp: "Formatted at 2026-08-12 00:03:03 on dist-test-slave-vpvm"
server_key: "e3904a53219ef8960c2b6d7e6e82ee62"
server_key_iv: "03573be08b5d2ebdb5418f012ec754ab"
server_key_version: "encryptionkey@0"
I20260812 00:03:03.956710 15924 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260812 00:03:03.957783 15951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:03.957999 15924 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:03:03.958101 15924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "4f3bab7efac44dea914aecf2a7422317"
format_stamp: "Formatted at 2026-08-12 00:03:03 on dist-test-slave-vpvm"
server_key: "e3904a53219ef8960c2b6d7e6e82ee62"
server_key_iv: "03573be08b5d2ebdb5418f012ec754ab"
server_key_version: "encryptionkey@0"
I20260812 00:03:03.958163 15924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:03.965837 15924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:03.968118 15924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:03.968336 15924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:03.968606 15924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:03:03.968976 15924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:03:03.969023 15924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:03.969046 15924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:03:03.969064 15924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:03.980305 15924 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:38949
I20260812 00:03:03.980387 16158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:38949 every 8 connection(s)
I20260812 00:03:03.980706 15924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:03:03.986129 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 15924
I20260812 00:03:03.986250 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:03:03.986467 26013 external_mini_cluster.cc:1428] Setting key c9ba60790bb4d2bc2601475444a8c448
Aug 12 00:03:03 dist-test-slave-vpvm krb5kdc[15732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492983, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:03:03.991292 15884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:03.981504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:60575 (local address 127.25.103.126:42771)
0812 00:03:03.981582 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:03.981584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:03.981758 (+ 174us) server_negotiation.cc:407] Connection header received
0812 00:03:03.982467 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:03.982468 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:03.982479 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:03.982551 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:03.983625 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:03.984143 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:03.985167 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:03.985385 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:03.985442 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:03.988059 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:03.988061 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:03.988061 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:03.988069 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:03.989529 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:03.990042 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:03.990043 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:03.990043 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:03.990106 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:03.990488 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:03.990489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:03.990490 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:03.990613 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:03.990672 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:03.991146 (+ 474us) server_negotiation.cc:299] Negotiation successful
0812 00:03:03.991227 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 00:03:03.991412 16164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:03.981453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:60575)
0812 00:03:03.981636 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:03.981676 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:03.982333 (+ 657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:03.982702 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:03.982706 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:03.983313 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:03.983520 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:03.983524 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:03.984260 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:03.984261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:03.985084 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:03.985086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:03.985487 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:03.985488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:03.985602 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:03.986173 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:03.986184 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:03.987936 (+ 1752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:03.989613 (+ 1677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:03.989621 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:03.989624 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:03.989930 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:03.990174 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:03.990175 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:03.990176 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:03.990311 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:03.990683 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:03.990691 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:03.990863 (+ 172us) client_negotiation.cc:769] Sending connection context
0812 00:03:03.990977 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 00:03:03.991155 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":82,"threads_started":1}
I20260812 00:03:03.992130 16159 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42771
I20260812 00:03:03.992319 16159 heartbeater.cc:464] Registering TS with master...
I20260812 00:03:03.992659 16159 heartbeater.cc:511] Master 127.25.103.126:42771 requested a full tablet report, sending...
I20260812 00:03:03.993271 15810 ts_manager.cc:194] Registered new tserver with Master: 4f3bab7efac44dea914aecf2a7422317 (127.25.103.65:38949)
I20260812 00:03:03.994237 15810 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:60575
WARNING: no policy specified for kudu/127.25.103.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
I20260812 00:03:04.014251 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42771
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:03:04.099509 16167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:04.099725 16167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:04.099748 16167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:04.100889 16167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:04.100932 16167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:04.100956 16167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:03:04.102638 16167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42771
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:04.102998 16167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:04.103253 16167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:04.108284 16186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:04.108333 16177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:04.108289 16182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:04.108676 16167 server_base.cc:1034] running on GCE node
I20260812 00:03:04.108892 16167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:04.109140 16167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:04.110316 16167 hybrid_clock.cc:648] HybridClock initialized: now 1786492984110301 us; error 27 us; skew 500 ppm
Aug 12 00:03:04 dist-test-slave-vpvm krb5kdc[15732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492984, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:04.114148 16167 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:03:04.114749 16167 webserver.cc:460] Webserver started at http://127.25.103.66:44877/ using document root <none> and password file <none>
I20260812 00:03:04.115077 16167 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:04.115134 16167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:04.115263 16167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:03:04.116408 16167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "0d638206fc0c436f9f783f7193605f9d"
format_stamp: "Formatted at 2026-08-12 00:03:04 on dist-test-slave-vpvm"
server_key: "9efba861fcb08a4ecbf7e322ffe77e1c"
server_key_iv: "60d728e116fd5009906c47e1bed4a6cf"
server_key_version: "encryptionkey@0"
I20260812 00:03:04.116991 16167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "0d638206fc0c436f9f783f7193605f9d"
format_stamp: "Formatted at 2026-08-12 00:03:04 on dist-test-slave-vpvm"
server_key: "9efba861fcb08a4ecbf7e322ffe77e1c"
server_key_iv: "60d728e116fd5009906c47e1bed4a6cf"
server_key_version: "encryptionkey@0"
I20260812 00:03:04.118706 16167 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260812 00:03:04.119537 16194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:04.119805 16167 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:04.119889 16167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "0d638206fc0c436f9f783f7193605f9d"
format_stamp: "Formatted at 2026-08-12 00:03:04 on dist-test-slave-vpvm"
server_key: "9efba861fcb08a4ecbf7e322ffe77e1c"
server_key_iv: "60d728e116fd5009906c47e1bed4a6cf"
server_key_version: "encryptionkey@0"
I20260812 00:03:04.119948 16167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:04.142762 16167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:04.145031 16167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:04.145157 16167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:04.145366 16167 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:03:04.145674 16167 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:03:04.145710 16167 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:04.145735 16167 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:03:04.145757 16167 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:04.154577 16167 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:33585
I20260812 00:03:04.154647 16397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:33585 every 8 connection(s)
I20260812 00:03:04.154968 16167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:03:04.160719 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 16167
I20260812 00:03:04.160816 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:03:04.160990 26013 external_mini_cluster.cc:1428] Setting key b4d1824bd69aa064e1ddc908d5cd5436
Aug 12 00:03:04 dist-test-slave-vpvm krb5kdc[15732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492984, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:03:04.165192 15884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.155721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:49125 (local address 127.25.103.126:42771)
0812 00:03:04.155771 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:04.155772 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:04.156114 (+ 342us) server_negotiation.cc:407] Connection header received
0812 00:03:04.156644 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:04.156645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:04.156656 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:04.156705 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:04.158032 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.158552 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.159531 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.159734 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.159791 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:04.162228 (+ 2437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:04.162229 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:04.162229 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:04.162237 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:04.163722 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:04.164165 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:04.164167 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:04.164167 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:04.164287 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:04.164539 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:04.164540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:04.164540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:04.164690 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:04.164759 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:04.165001 (+ 242us) server_negotiation.cc:299] Negotiation successful
0812 00:03:04.165099 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:03:04.165285 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.155673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:49125)
0812 00:03:04.155857 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:04.156014 (+ 157us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:04.156549 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:04.156787 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:04.156791 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:04.157385 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:04.157887 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:04.157894 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.158637 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.158639 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:04.159448 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:04.159452 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.159807 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.159808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:04.159927 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:04.160521 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:04.160530 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:04.162138 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:04.163824 (+ 1686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:04.163832 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:04.163834 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:04.164089 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:04.164355 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:04.164356 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:04.164356 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:04.164478 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:04.164752 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:04.164755 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:04.164878 (+ 123us) client_negotiation.cc:769] Sending connection context
0812 00:03:04.164965 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 00:03:04.165100 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":85,"threads_started":1}
I20260812 00:03:04.165841 16398 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42771
I20260812 00:03:04.165980 16398 heartbeater.cc:464] Registering TS with master...
I20260812 00:03:04.166164 16398 heartbeater.cc:511] Master 127.25.103.126:42771 requested a full tablet report, sending...
I20260812 00:03:04.166651 15810 ts_manager.cc:194] Registered new tserver with Master: 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585)
I20260812 00:03:04.167156 15810 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:49125
WARNING: no policy specified for kudu/127.25.103.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
I20260812 00:03:04.189410 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42771
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:03:04.275458 16409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:04.275686 16409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:04.275710 16409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:04.276868 16409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:04.276911 16409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:04.276937 16409 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:03:04.278451 16409 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42771
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:04.278759 16409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:04.279002 16409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:04.284014 16425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:04.284014 16420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:04.284062 16418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:04.284292 16409 server_base.cc:1034] running on GCE node
I20260812 00:03:04.284488 16409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:04.284710 16409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:04.285888 16409 hybrid_clock.cc:648] HybridClock initialized: now 1786492984285873 us; error 31 us; skew 500 ppm
Aug 12 00:03:04 dist-test-slave-vpvm krb5kdc[15732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492984, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:04.288458 16409 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:03:04.288918 16409 webserver.cc:460] Webserver started at http://127.25.103.67:34539/ using document root <none> and password file <none>
I20260812 00:03:04.289104 16409 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:04.289151 16409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:04.289244 16409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:03:04.290313 16409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "2c96c865f9464c7691793bc691bc444c"
format_stamp: "Formatted at 2026-08-12 00:03:04 on dist-test-slave-vpvm"
server_key: "5acb5f93734e7c1873f16fbde7a30581"
server_key_iv: "27fafc7aeee227bd237593ff958bba0c"
server_key_version: "encryptionkey@0"
I20260812 00:03:04.290629 16409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "2c96c865f9464c7691793bc691bc444c"
format_stamp: "Formatted at 2026-08-12 00:03:04 on dist-test-slave-vpvm"
server_key: "5acb5f93734e7c1873f16fbde7a30581"
server_key_iv: "27fafc7aeee227bd237593ff958bba0c"
server_key_version: "encryptionkey@0"
I20260812 00:03:04.292016 16409 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:03:04.292721 16436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:04.293016 16409 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:04.293111 16409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "2c96c865f9464c7691793bc691bc444c"
format_stamp: "Formatted at 2026-08-12 00:03:04 on dist-test-slave-vpvm"
server_key: "5acb5f93734e7c1873f16fbde7a30581"
server_key_iv: "27fafc7aeee227bd237593ff958bba0c"
server_key_version: "encryptionkey@0"
I20260812 00:03:04.293191 16409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:04.308179 16409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:04.310454 16409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:04.310575 16409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:04.310778 16409 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:03:04.311095 16409 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:03:04.311134 16409 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:04.311158 16409 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:03:04.311169 16409 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:04.317770 16409 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:36711
I20260812 00:03:04.317823 16653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:36711 every 8 connection(s)
I20260812 00:03:04.318199 16409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:03:04 dist-test-slave-vpvm krb5kdc[15732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492984, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:03:04.326319 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 16409
I20260812 00:03:04.326419 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:03:04.326606 26013 external_mini_cluster.cc:1428] Setting key 70e175b95964563259db4597cd892fab
I20260812 00:03:04.327929 15884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.318960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:60209 (local address 127.25.103.126:42771)
0812 00:03:04.319040 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:04.319042 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:04.319240 (+ 198us) server_negotiation.cc:407] Connection header received
0812 00:03:04.319714 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:04.319715 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:04.319724 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:04.319773 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:04.320713 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.321220 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.322318 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.322516 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.322581 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:04.324759 (+ 2178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:04.324760 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:04.324760 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:04.324768 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:04.326312 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:04.326811 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:04.326812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:04.326813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:04.326953 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:04.327233 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:04.327234 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:04.327234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:04.327380 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:04.327448 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:04.327788 (+ 340us) server_negotiation.cc:299] Negotiation successful
0812 00:03:04.327865 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 00:03:04.328060 16657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.318933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:60209)
0812 00:03:04.319094 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:04.319130 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:04.319632 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:04.319826 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:04.319830 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:04.320407 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:04.320608 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:04.320613 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.321323 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.321324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:04.322226 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:04.322229 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.322588 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.322588 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:04.322682 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:04.323186 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:04.323194 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:04.324663 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:04.326410 (+ 1747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:04.326419 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:04.326422 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:04.326740 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:04.327023 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:04.327024 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:04.327024 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:04.327168 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:04.327455 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:04.327462 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:04.327645 (+ 183us) client_negotiation.cc:769] Sending connection context
0812 00:03:04.327735 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 00:03:04.327872 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":91,"threads_started":1}
I20260812 00:03:04.328467 16655 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42771
I20260812 00:03:04.328565 16655 heartbeater.cc:464] Registering TS with master...
I20260812 00:03:04.328739 16655 heartbeater.cc:511] Master 127.25.103.126:42771 requested a full tablet report, sending...
I20260812 00:03:04.329134 15810 ts_manager.cc:194] Registered new tserver with Master: 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711)
I20260812 00:03:04.329522 15810 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:60209
I20260812 00:03:04.338934 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:03:04.346801 15884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.340422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54082 (local address 127.25.103.126:42771)
0812 00:03:04.340508 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:04.340510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:04.340631 (+ 121us) server_negotiation.cc:407] Connection header received
0812 00:03:04.340659 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:04.340659 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:04.340670 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:04.340721 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:04.341258 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.341836 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.342627 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.342813 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.342875 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:04.344056 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:04.344057 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:04.344058 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:04.344063 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:04.345463 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:04.345804 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:04.345806 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:04.345806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:04.345870 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:04.346166 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:04.346168 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:04.346168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:04.346349 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:04.346455 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:04.346635 (+ 180us) server_negotiation.cc:299] Negotiation successful
0812 00:03:04.346706 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 00:03:04.348796 15810 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54082:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:03:04.350620 15810 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:03:04.357899 16672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.353140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:33585 (local address 127.0.0.1:59252)
0812 00:03:04.353896 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:04.353908 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:04.354118 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:04.354409 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:04.354410 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:04.354412 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:04.354485 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:04.354487 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.355724 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.355725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:04.356797 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:04.356800 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.357624 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.357625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:04.357693 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:04.357704 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:03:04.357784 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 00:03:04.357834 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"mutex_wait_us":64,"thread_start_us":96,"threads_started":1}
I20260812 00:03:04.357928 16678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.353346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59252 (local address 127.25.103.66:33585)
0812 00:03:04.353569 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:04.353574 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:04.354085 (+ 511us) server_negotiation.cc:407] Connection header received
0812 00:03:04.354225 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:04.354227 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:04.354244 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:04.354296 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:04.354583 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.355645 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.356876 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.357458 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.357541 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:04.357601 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:04.357801 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 00:03:04.357843 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":100,"threads_started":1}
I20260812 00:03:04.358249 16676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.353137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:38949 (local address 127.0.0.1:37520)
0812 00:03:04.353764 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:04.353806 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:04.353873 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:04.354217 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:04.354220 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:04.354222 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:04.354291 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:04.354292 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.355664 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.355665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:04.357160 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:04.357162 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.358024 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.358035 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:04.358099 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:04.358103 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:03:04.358147 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:03:04.358185 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"mutex_wait_us":31,"thread_start_us":63,"threads_started":1}
I20260812 00:03:04.358611 16680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.353590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37520 (local address 127.25.103.65:38949)
0812 00:03:04.354044 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:04.354048 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:04.354058 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:03:04.354098 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:04.354101 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:04.354116 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:04.354346 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:04.354415 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.355541 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.357248 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.357903 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.358006 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:04.358077 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:04.358495 (+ 418us) server_negotiation.cc:299] Negotiation successful
0812 00:03:04.358543 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":183,"threads_started":1}
I20260812 00:03:04.358773 16283 tablet_service.cc:1467] Processing CreateTablet for tablet 0da3dc9c5e01467cb427672890cda688 (DEFAULT_TABLE table=test-table [id=3ac6a74633494d158edbcddf232da40a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:03:04.359172 16283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0da3dc9c5e01467cb427672890cda688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:04.359252 16038 tablet_service.cc:1467] Processing CreateTablet for tablet 0da3dc9c5e01467cb427672890cda688 (DEFAULT_TABLE table=test-table [id=3ac6a74633494d158edbcddf232da40a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:03:04.359570 16038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0da3dc9c5e01467cb427672890cda688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:04.362928 16682 tablet_bootstrap.cc:492] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d: Bootstrap starting.
I20260812 00:03:04.363077 16679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.353542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60176 (local address 127.25.103.67:36711)
0812 00:03:04.353703 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:04.353735 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:04.354252 (+ 517us) server_negotiation.cc:407] Connection header received
0812 00:03:04.354301 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:04.354303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:04.354317 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:04.354394 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:04.354511 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.355232 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.358124 (+ 2892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.362588 (+ 4464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.362671 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:04.362743 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:04.362952 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 00:03:04.362997 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":86,"threads_started":1}
I20260812 00:03:04.363092 16671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.353342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:36711 (local address 127.0.0.1:60176)
0812 00:03:04.354129 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:04.354138 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:04.354188 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:04.354405 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:04.354406 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:04.354408 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:04.354452 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:04.354454 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.355330 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.355331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:04.357159 (+ 1828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:04.357162 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.362785 (+ 5623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.362786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:04.362860 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:04.362865 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:03:04.362919 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 00:03:04.362971 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":775,"mutex_wait_us":51,"thread_start_us":79,"threads_started":1}
I20260812 00:03:04.363610 16682 tablet_bootstrap.cc:654] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:04.363898 16524 tablet_service.cc:1467] Processing CreateTablet for tablet 0da3dc9c5e01467cb427672890cda688 (DEFAULT_TABLE table=test-table [id=3ac6a74633494d158edbcddf232da40a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:03:04.364096 16682 log.cc:824] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:04.364209 16524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0da3dc9c5e01467cb427672890cda688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:04.364374 16681 tablet_bootstrap.cc:492] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317: Bootstrap starting.
I20260812 00:03:04.365079 16681 tablet_bootstrap.cc:654] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:04.365520 16681 log.cc:824] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:04.366093 16682 tablet_bootstrap.cc:492] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d: No bootstrap required, opened a new log
I20260812 00:03:04.366154 16682 ts_tablet_manager.cc:1397] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:03:04.366358 16681 tablet_bootstrap.cc:492] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317: No bootstrap required, opened a new log
I20260812 00:03:04.366464 16681 ts_tablet_manager.cc:1397] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260812 00:03:04.367199 16688 tablet_bootstrap.cc:492] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c: Bootstrap starting.
I20260812 00:03:04.367871 16688 tablet_bootstrap.cc:654] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:04.367983 16682 raft_consensus.cc:348] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:04.368213 16682 raft_consensus.cc:374] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:04.368269 16682 raft_consensus.cc:729] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d638206fc0c436f9f783f7193605f9d, State: Initialized, Role: FOLLOWER
I20260812 00:03:04.368227 16681 raft_consensus.cc:348] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:04.368484 16681 raft_consensus.cc:374] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:04.368543 16681 raft_consensus.cc:729] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bab7efac44dea914aecf2a7422317, State: Initialized, Role: FOLLOWER
I20260812 00:03:04.368396 16682 consensus_queue.cc:260] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:04.368659 16681 consensus_queue.cc:260] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:04.368712 16688 log.cc:824] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:04.368921 16398 heartbeater.cc:503] Master 127.25.103.126:42771 was elected leader, sending a full tablet report...
I20260812 00:03:04.368935 16681 ts_tablet_manager.cc:1428] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:03:04.369035 16159 heartbeater.cc:503] Master 127.25.103.126:42771 was elected leader, sending a full tablet report...
I20260812 00:03:04.369259 16682 ts_tablet_manager.cc:1428] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:03:04.370255 16688 tablet_bootstrap.cc:492] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c: No bootstrap required, opened a new log
I20260812 00:03:04.370368 16688 ts_tablet_manager.cc:1397] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:03:04.371722 16688 raft_consensus.cc:348] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:04.371860 16688 raft_consensus.cc:374] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:04.371881 16688 raft_consensus.cc:729] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c96c865f9464c7691793bc691bc444c, State: Initialized, Role: FOLLOWER
I20260812 00:03:04.371959 16688 consensus_queue.cc:260] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:04.372192 16688 ts_tablet_manager.cc:1428] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:03:04.372319 16655 heartbeater.cc:503] Master 127.25.103.126:42771 was elected leader, sending a full tablet report...
W20260812 00:03:04.405696 16399 tablet.cc:2369] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:03:04.481572 16162 tablet.cc:2369] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:03:04.543596 16692 raft_consensus.cc:482] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:03:04.543757 16692 raft_consensus.cc:504] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:04.544096 16692 leader_election.cc:288] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585), 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711)
I20260812 00:03:04.547763 16695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.544409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:33585 (local address 127.25.103.65:34205)
0812 00:03:04.544622 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:04.544639 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:04.544753 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:04.544929 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:04.544931 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:04.544937 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:04.545080 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:04.545084 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.545837 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.545838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:04.546830 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:04.546834 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.547488 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.547490 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:04.547568 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:04.547575 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 00:03:04.547635 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 00:03:04.547678 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":125,"threads_started":1}
I20260812 00:03:04.547806 16678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.544576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:34205 (local address 127.25.103.66:33585)
0812 00:03:04.544669 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:04.544672 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:04.544732 (+ 60us) server_negotiation.cc:407] Connection header received
0812 00:03:04.544817 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:04.544818 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:04.544829 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:04.544891 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:04.545174 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.545724 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.546937 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.547386 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.547447 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:04.547456 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:04.547673 (+ 217us) server_negotiation.cc:299] Negotiation successful
0812 00:03:04.547729 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 00:03:04.547924 16679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.544780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:38959 (local address 127.25.103.67:36711)
0812 00:03:04.544849 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:04.544851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:04.544947 (+ 96us) server_negotiation.cc:407] Connection header received
0812 00:03:04.545006 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:04.545007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:04.545021 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:04.545105 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:04.545424 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.546068 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.547068 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.547517 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.547601 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:04.547610 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:04.547802 (+ 192us) server_negotiation.cc:299] Negotiation successful
0812 00:03:04.547855 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:03:04.547906 16698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.544696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:36711 (local address 127.25.103.65:38959)
0812 00:03:04.544874 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:04.544884 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:04.544947 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:04.545127 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:04.545128 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:04.545130 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:04.545257 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:04.545259 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.546171 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.546172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:04.546944 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:04.546947 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.547632 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.547633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:04.547713 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:04.547717 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:03:04.547787 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 00:03:04.547827 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":85,"threads_started":1}
I20260812 00:03:04.548391 16319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0da3dc9c5e01467cb427672890cda688" candidate_uuid: "4f3bab7efac44dea914aecf2a7422317" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d638206fc0c436f9f783f7193605f9d" is_pre_election: true
I20260812 00:03:04.548391 16563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0da3dc9c5e01467cb427672890cda688" candidate_uuid: "4f3bab7efac44dea914aecf2a7422317" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c96c865f9464c7691793bc691bc444c" is_pre_election: true
I20260812 00:03:04.548592 16319 raft_consensus.cc:2454] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bab7efac44dea914aecf2a7422317 in term 0.
I20260812 00:03:04.548592 16563 raft_consensus.cc:2454] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bab7efac44dea914aecf2a7422317 in term 0.
I20260812 00:03:04.548867 15952 leader_election.cc:302] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c96c865f9464c7691793bc691bc444c, 4f3bab7efac44dea914aecf2a7422317; no voters:
I20260812 00:03:04.549017 16692 raft_consensus.cc:2781] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:03:04.549078 16692 raft_consensus.cc:482] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:03:04.549108 16692 raft_consensus.cc:3037] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:03:04.549863 16692 raft_consensus.cc:504] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:04.550050 16692 leader_election.cc:288] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 1 election: Requested vote from peers 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585), 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711)
I20260812 00:03:04.550293 16319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0da3dc9c5e01467cb427672890cda688" candidate_uuid: "4f3bab7efac44dea914aecf2a7422317" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d638206fc0c436f9f783f7193605f9d"
I20260812 00:03:04.550376 16319 raft_consensus.cc:3037] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:03:04.550341 16563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0da3dc9c5e01467cb427672890cda688" candidate_uuid: "4f3bab7efac44dea914aecf2a7422317" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c96c865f9464c7691793bc691bc444c"
I20260812 00:03:04.550515 16563 raft_consensus.cc:3037] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:03:04.551178 16319 raft_consensus.cc:2454] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bab7efac44dea914aecf2a7422317 in term 1.
I20260812 00:03:04.551412 15952 leader_election.cc:302] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d638206fc0c436f9f783f7193605f9d, 4f3bab7efac44dea914aecf2a7422317; no voters:
I20260812 00:03:04.551515 16692 raft_consensus.cc:2781] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:03:04.551690 16692 raft_consensus.cc:686] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [term 1 LEADER]: Becoming Leader. State: Replica: 4f3bab7efac44dea914aecf2a7422317, State: Running, Role: LEADER
I20260812 00:03:04.551792 16692 consensus_queue.cc:237] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:04.552024 16563 raft_consensus.cc:2454] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bab7efac44dea914aecf2a7422317 in term 1.
I20260812 00:03:04.552809 15809 catalog_manager.cc:5495] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f3bab7efac44dea914aecf2a7422317 (127.25.103.65). New cstate: current_term: 1 leader_uuid: "4f3bab7efac44dea914aecf2a7422317" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } health_report { overall_health: HEALTHY } } }
W20260812 00:03:04.569043 16656 tablet.cc:2369] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:03:04.587481 16680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.584508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37532 (local address 127.25.103.65:38949)
0812 00:03:04.584569 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:04.584571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:04.584581 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:03:04.584630 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:04.584631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:04.584654 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:04.584738 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:03:04.585009 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.585499 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.586351 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:04.586565 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:04.586632 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:04.586977 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:03:04.587139 (+ 162us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:03:04.587233 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:04.587349 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 00:03:04.587389 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:03:04.589792 16319 raft_consensus.cc:1261] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d [term 1 FOLLOWER]: Refusing update from remote peer 4f3bab7efac44dea914aecf2a7422317: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:03:04.589793 16563 raft_consensus.cc:1261] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c [term 1 FOLLOWER]: Refusing update from remote peer 4f3bab7efac44dea914aecf2a7422317: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:03:04.590193 16692 consensus_queue.cc:1035] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:03:04.590364 16702 consensus_queue.cc:1035] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:03:04.596854 15810 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54082:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:03:04.596969 15810 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54082:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:03:04.597846 15810 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78: Sending DeleteTablet for 3 replicas of tablet 0da3dc9c5e01467cb427672890cda688
I20260812 00:03:04.598270 16524 tablet_service.cc:1514] Processing DeleteTablet for tablet 0da3dc9c5e01467cb427672890cda688 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:03:04 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:60176
I20260812 00:03:04.598266 16038 tablet_service.cc:1514] Processing DeleteTablet for tablet 0da3dc9c5e01467cb427672890cda688 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:03:04 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:37520
I20260812 00:03:04.598569 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 15924
I20260812 00:03:04.598629 16283 tablet_service.cc:1514] Processing DeleteTablet for tablet 0da3dc9c5e01467cb427672890cda688 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:03:04 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:59252
I20260812 00:03:04.598654 16724 tablet_replica.cc:330] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c: stopping tablet replica
I20260812 00:03:04.608687 16724 raft_consensus.cc:2229] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:03:04.608842 16724 raft_consensus.cc:2258] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:03:04.609431 16724 ts_tablet_manager.cc:1905] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:03:04.610296 16729 tablet_replica.cc:330] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d: stopping tablet replica
I20260812 00:03:04.610445 16729 raft_consensus.cc:2229] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:03:04.610574 16729 raft_consensus.cc:2258] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:03:04.611018 16729 ts_tablet_manager.cc:1905] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:03:04.611356 16724 ts_tablet_manager.cc:1918] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:03:04.611441 16724 log.cc:1196] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/0da3dc9c5e01467cb427672890cda688
I20260812 00:03:04.611750 16724 ts_tablet_manager.cc:1939] T 0da3dc9c5e01467cb427672890cda688 P 2c96c865f9464c7691793bc691bc444c: Deleting consensus metadata
I20260812 00:03:04.612360 16729 ts_tablet_manager.cc:1918] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:03:04.612360 15781 catalog_manager.cc:4841] TS 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711): tablet 0da3dc9c5e01467cb427672890cda688 (table test-table [id=3ac6a74633494d158edbcddf232da40a]) successfully deleted
I20260812 00:03:04.612445 16729 log.cc:1196] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/0da3dc9c5e01467cb427672890cda688
I20260812 00:03:04.612655 16729 ts_tablet_manager.cc:1939] T 0da3dc9c5e01467cb427672890cda688 P 0d638206fc0c436f9f783f7193605f9d: Deleting consensus metadata
I20260812 00:03:04.613024 15781 catalog_manager.cc:4841] TS 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585): tablet 0da3dc9c5e01467cb427672890cda688 (table test-table [id=3ac6a74633494d158edbcddf232da40a]) successfully deleted
W20260812 00:03:04.614910 15784 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.103.65:38949 (error 108)
I20260812 00:03:04.615542 16671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.615405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:38949 (local address 127.0.0.1:37548)
0812 00:03:04.615454 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:04.615495 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:38949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 00:03:04.615607 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 16167
W20260812 00:03:04.615711 15784 catalog_manager.cc:4584] TS 4f3bab7efac44dea914aecf2a7422317 (127.25.103.65:38949): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0da3dc9c5e01467cb427672890cda688: Network error: Client connection negotiation failed: client connection to 127.25.103.65:38949: connect: Connection refused (error 111)
I20260812 00:03:04.639429 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 16409
I20260812 00:03:04.668638 16671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.668477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:38949 (local address 127.0.0.1:37562)
0812 00:03:04.668556 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:04.668594 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:38949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 00:03:04.669008 16671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:04.668931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:38949 (local address 127.0.0.1:37576)
0812 00:03:04.668962 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:04.668988 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:38949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260812 00:03:04.673301 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 15755
I20260812 00:03:04.693627 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:42771
--webserver_interface=127.25.103.126
--webserver_port=44637
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:42771
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:03:04.786085 16733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:04.786334 16733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:04.786370 16733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:04.787649 16733 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:03:04.787705 16733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:04.787725 16733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:04.787741 16733 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:03:04.787757 16733 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:03:04.789404 16733 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:42771
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:42771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=44637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:04.789691 16733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:04.789937 16733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:04.802870 16749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:04.802862 16750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:04.802863 16753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:04.803150 16733 server_base.cc:1034] running on GCE node
I20260812 00:03:04.803455 16733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:04.803808 16733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:04.805001 16733 hybrid_clock.cc:648] HybridClock initialized: now 1786492984804941 us; error 68 us; skew 500 ppm
Aug 12 00:03:04 dist-test-slave-vpvm krb5kdc[15732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492984, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:04.808063 16733 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:03:04.808605 16733 webserver.cc:460] Webserver started at http://127.25.103.126:44637/ using document root <none> and password file <none>
I20260812 00:03:04.808861 16733 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:04.808933 16733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:04.810561 16733 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:03:04.811331 16765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:04.811501 16733 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:04.811600 16733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "f7c7742675c14024b02710088a902e78"
format_stamp: "Formatted at 2026-08-12 00:03:03 on dist-test-slave-vpvm"
server_key: "3eb2d26c4732dac8eb0d8d31c5a58a07"
server_key_iv: "6547a33835e52cdf9a64f28d8b2f5768"
server_key_version: "encryptionkey@0"
I20260812 00:03:04.812067 16733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:04.829007 16733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:04.831744 16733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:04.831939 16733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:04.836980 16733 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:42771
I20260812 00:03:04.837054 16851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:42771 every 8 connection(s)
I20260812 00:03:04.837460 16733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:03:04.839370 16852 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:03:04.840118 16852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78: Bootstrap starting.
I20260812 00:03:04.841490 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 16733
I20260812 00:03:04.841857 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:38949
--local_ip_for_outbound_sockets=127.25.103.65
--tserver_master_addrs=127.25.103.126:42771
--webserver_port=44369
--webserver_interface=127.25.103.65
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:03:04.850145 16852 log.cc:824] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:04.852190 16852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:03:04.852502 16852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78: Bootstrap complete.
I20260812 00:03:04.855140 16852 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c7742675c14024b02710088a902e78" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42771 } }
I20260812 00:03:04.855469 16852 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c7742675c14024b02710088a902e78, State: Initialized, Role: FOLLOWER
I20260812 00:03:04.855674 16852 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c7742675c14024b02710088a902e78" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42771 } }
I20260812 00:03:04.855762 16852 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:03:04.855819 16852 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:03:04.855870 16852 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:03:04.857296 16852 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c7742675c14024b02710088a902e78" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42771 } }
I20260812 00:03:04.857512 16852 leader_election.cc:302] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7c7742675c14024b02710088a902e78; no voters:
I20260812 00:03:04.857805 16852 leader_election.cc:288] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:03:04.857869 16857 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:03:04.858040 16857 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 2 LEADER]: Becoming Leader. State: Replica: f7c7742675c14024b02710088a902e78, State: Running, Role: LEADER
I20260812 00:03:04.858168 16857 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c7742675c14024b02710088a902e78" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42771 } }
I20260812 00:03:04.858220 16852 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:03:04.858651 16858 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f7c7742675c14024b02710088a902e78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c7742675c14024b02710088a902e78" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42771 } } }
I20260812 00:03:04.858917 16858 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [sys.catalog]: This master's current role is: LEADER
I20260812 00:03:04.859382 16868 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:03:04.859701 16859 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7c7742675c14024b02710088a902e78. Latest consensus state: current_term: 2 leader_uuid: "f7c7742675c14024b02710088a902e78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c7742675c14024b02710088a902e78" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42771 } } }
I20260812 00:03:04.859817 16859 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [sys.catalog]: This master's current role is: LEADER
I20260812 00:03:04.860684 16868 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:03:04.861065 16868 catalog_manager.cc:1259] Loaded cluster ID: c72639eda8aa4fe2807d5ec70ebff153
I20260812 00:03:04.861200 16868 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:03:04.861548 16868 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 00:03:04.866796 16868 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 00:03:04.869752 16868 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:03:04.870087 16868 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78: Loaded TSK: 0
I20260812 00:03:04.870316 16868 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:03:04.946897 16854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:04.947166 16854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:04.947198 16854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:04.949203 16854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:04.949330 16854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:04.949391 16854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:03:04.951822 16854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:38949
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=44369
--tserver_master_addrs=127.25.103.126:42771
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:04.952129 16854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:04.952420 16854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:04.960994 16904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:04.960988 16902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:04.961198 16901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:04.961069 16854 server_base.cc:1034] running on GCE node
I20260812 00:03:04.961664 16854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:04.962023 16854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:04.963289 16854 hybrid_clock.cc:648] HybridClock initialized: now 1786492984963197 us; error 56 us; skew 500 ppm
Aug 12 00:03:04 dist-test-slave-vpvm krb5kdc[15732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492984, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:04.966598 16854 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:03:04.967151 16854 webserver.cc:460] Webserver started at http://127.25.103.65:44369/ using document root <none> and password file <none>
I20260812 00:03:04.967386 16854 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:04.967456 16854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:04.968933 16854 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 00:03:04.969630 16918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:04.969863 16854 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:04.969983 16854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "4f3bab7efac44dea914aecf2a7422317"
format_stamp: "Formatted at 2026-08-12 00:03:03 on dist-test-slave-vpvm"
server_key: "e3904a53219ef8960c2b6d7e6e82ee62"
server_key_iv: "03573be08b5d2ebdb5418f012ec754ab"
server_key_version: "encryptionkey@0"
I20260812 00:03:04.970410 16854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:04.992199 16854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:04.995442 16854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:04.995628 16854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:04.995908 16854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:03:04.996709 16931 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 00:03:04.998616 16854 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 00:03:04.998677 16854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 00:03:04.998708 16854 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 00:03:04.999761 16854 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 00:03:04.999831 16854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 00:03:04.999895 16931 tablet_bootstrap.cc:492] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317: Bootstrap starting.
I20260812 00:03:05.008733 16854 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:38949
I20260812 00:03:05.008836 17136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:38949 every 8 connection(s)
I20260812 00:03:05.009367 16854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:03:05.010567 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 16854
I20260812 00:03:05.010874 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:33585
--local_ip_for_outbound_sockets=127.25.103.66
--tserver_master_addrs=127.25.103.126:42771
--webserver_port=44877
--webserver_interface=127.25.103.66
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:03:05.012445 16931 log.cc:824] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:05.015205 16931 tablet_bootstrap.cc:492] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:03:05.015492 16931 tablet_bootstrap.cc:492] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317: Bootstrap complete.
I20260812 00:03:05.016479 16931 ts_tablet_manager.cc:1397] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.007s
I20260812 00:03:05.017589 16931 raft_consensus.cc:348] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:05.017844 16931 raft_consensus.cc:729] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bab7efac44dea914aecf2a7422317, State: Initialized, Role: FOLLOWER
I20260812 00:03:05.018049 16931 consensus_queue.cc:260] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:05.018396 16931 ts_tablet_manager.cc:1428] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
Aug 12 00:03:05 dist-test-slave-vpvm krb5kdc[15732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492984, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:03:05.026069 17141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.010375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:39053)
0812 00:03:05.010616 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:05.010717 (+ 101us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:05.011352 (+ 635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:05.011946 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:05.011951 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:05.012320 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:05.012663 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:05.012672 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.014251 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.014252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:05.015499 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:05.015503 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.017428 (+ 1925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.017430 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:05.017630 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.018423 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:05.018437 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:05.020610 (+ 2173us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:05.023904 (+ 3294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:05.023920 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:05.023923 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:05.024272 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:05.024654 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:05.024655 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:05.024655 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:05.024790 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:05.025366 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:05.025387 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:05.025539 (+ 152us) client_negotiation.cc:769] Sending connection context
0812 00:03:05.025645 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 00:03:05.025819 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":130,"threads_started":1}
I20260812 00:03:05.026316 17142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.010541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:39053 (local address 127.25.103.126:42771)
0812 00:03:05.010718 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:05.010729 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:05.010827 (+ 98us) server_negotiation.cc:407] Connection header received
0812 00:03:05.011642 (+ 815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:05.011650 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:05.011733 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:05.011909 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:05.012784 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.014103 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.015628 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.017001 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.017162 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.020915 (+ 3753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:05.020924 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:05.020924 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:05.020947 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:05.023721 (+ 2774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:05.024391 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:05.024395 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:05.024396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:05.024544 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:05.024868 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:05.024869 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:05.024869 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:05.025262 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:05.025360 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:05.025723 (+ 363us) server_negotiation.cc:299] Negotiation successful
0812 00:03:05.025897 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":90,"threads_started":1}
I20260812 00:03:05.027117 17138 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42771
I20260812 00:03:05.027217 17138 heartbeater.cc:464] Registering TS with master...
I20260812 00:03:05.027405 17138 heartbeater.cc:511] Master 127.25.103.126:42771 requested a full tablet report, sending...
I20260812 00:03:05.028440 16790 ts_manager.cc:194] Registered new tserver with Master: 4f3bab7efac44dea914aecf2a7422317 (127.25.103.65:38949)
I20260812 00:03:05.029727 16790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:39053
I20260812 00:03:05.030783 17138 heartbeater.cc:503] Master 127.25.103.126:42771 was elected leader, sending a full tablet report...
Aug 12 00:03:05 dist-test-slave-vpvm krb5kdc[15732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492984, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for kudu/127.25.103.65@KRBTEST.COM
I20260812 00:03:05.038816 17160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.029219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:38949 (local address 127.0.0.1:37586)
0812 00:03:05.029405 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:05.029473 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:05.029552 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:05.029735 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:05.029739 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:05.030154 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:05.030215 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:05.030219 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.031112 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.031113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:05.031988 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:05.031993 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.032625 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.032626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:05.032712 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.033225 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:05.033231 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:05.034996 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:05.037221 (+ 2225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:05.037233 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:05.037235 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:05.037562 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:05.037899 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:05.037899 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:05.037900 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:05.038002 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:05.038387 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:05.038393 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:05.038461 (+ 68us) client_negotiation.cc:769] Sending connection context
0812 00:03:05.038545 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 00:03:05.038706 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":101,"threads_started":1}
I20260812 00:03:05.039068 17161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.029322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37586 (local address 127.25.103.65:38949)
0812 00:03:05.029537 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:05.029541 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:05.029553 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:03:05.029644 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:05.029647 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:05.029662 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:05.029723 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:05.030292 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.031038 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.032107 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.032543 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.032613 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.035115 (+ 2502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:05.035126 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:05.035126 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:05.035134 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:05.037079 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:05.037710 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:05.037714 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:05.037715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:05.037810 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:05.038082 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:05.038084 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:05.038085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:05.038311 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:05.038400 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:05.038656 (+ 256us) server_negotiation.cc:299] Negotiation successful
0812 00:03:05.038816 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":117,"threads_started":1}
I20260812 00:03:05.039487 17018 tablet_service.cc:1514] Processing DeleteTablet for tablet 0da3dc9c5e01467cb427672890cda688 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:03:04 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:37586
I20260812 00:03:05.040028 17162 tablet_replica.cc:330] stopping tablet replica
I20260812 00:03:05.040134 17162 raft_consensus.cc:2229] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:03:05.040208 17162 raft_consensus.cc:2258] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:03:05.040530 17162 ts_tablet_manager.cc:1905] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:03:05.042394 17162 ts_tablet_manager.cc:1918] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:03:05.042476 17162 log.cc:1196] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/wal/wals/0da3dc9c5e01467cb427672890cda688
I20260812 00:03:05.042667 17162 ts_tablet_manager.cc:1939] T 0da3dc9c5e01467cb427672890cda688 P 4f3bab7efac44dea914aecf2a7422317: Deleting consensus metadata
I20260812 00:03:05.043217 16773 catalog_manager.cc:4841] TS 4f3bab7efac44dea914aecf2a7422317 (127.25.103.65:38949): tablet 0da3dc9c5e01467cb427672890cda688 (table test-table [id=3ac6a74633494d158edbcddf232da40a]) successfully deleted
W20260812 00:03:05.111277 17148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:05.111528 17148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:05.111555 17148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:05.112871 17148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:05.112936 17148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:05.112967 17148 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:03:05.114845 17148 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:33585
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=44877
--tserver_master_addrs=127.25.103.126:42771
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17148
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:05.115144 17148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:05.115460 17148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:05.121290 17172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:05.121290 17174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:05.121326 17148 server_base.cc:1034] running on GCE node
W20260812 00:03:05.121290 17169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:05.121737 17148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:05.122051 17148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:05.123320 17148 hybrid_clock.cc:648] HybridClock initialized: now 1786492985123289 us; error 33 us; skew 500 ppm
Aug 12 00:03:05 dist-test-slave-vpvm krb5kdc[15732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492985, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:05.127220 17148 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:03:05.127832 17148 webserver.cc:460] Webserver started at http://127.25.103.66:44877/ using document root <none> and password file <none>
I20260812 00:03:05.128085 17148 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:05.128165 17148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:05.129848 17148 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:03:05.130798 17192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:05.131105 17148 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:03:05.131210 17148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "0d638206fc0c436f9f783f7193605f9d"
format_stamp: "Formatted at 2026-08-12 00:03:04 on dist-test-slave-vpvm"
server_key: "9efba861fcb08a4ecbf7e322ffe77e1c"
server_key_iv: "60d728e116fd5009906c47e1bed4a6cf"
server_key_version: "encryptionkey@0"
I20260812 00:03:05.131803 17148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:05.150983 17148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:05.153271 17148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:05.153426 17148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:05.153693 17148 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:03:05.154086 17148 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:03:05.154129 17148 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:05.154161 17148 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:03:05.154181 17148 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:05.160956 17148 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:33585
I20260812 00:03:05.161021 17389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:33585 every 8 connection(s)
I20260812 00:03:05.161701 17148 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:03:05.168872 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 17148
I20260812 00:03:05.169174 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:36711
--local_ip_for_outbound_sockets=127.25.103.67
--tserver_master_addrs=127.25.103.126:42771
--webserver_port=34539
--webserver_interface=127.25.103.67
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:03:05 dist-test-slave-vpvm krb5kdc[15732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492985, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:03:05.174243 17142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.162731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:42513 (local address 127.25.103.126:42771)
0812 00:03:05.162818 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:05.162820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:05.163030 (+ 210us) server_negotiation.cc:407] Connection header received
0812 00:03:05.163608 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:05.163610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:05.163624 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:05.163721 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:05.164800 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.165424 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.166916 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.167177 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.167257 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.170223 (+ 2966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:05.170226 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:05.170227 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:05.170237 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:05.171840 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:05.172573 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:05.172574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:05.172575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:05.172648 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:05.173104 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:05.173106 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:05.173107 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:05.173361 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:05.173472 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:05.174051 (+ 579us) server_negotiation.cc:299] Negotiation successful
0812 00:03:05.174167 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 00:03:05.174616 17394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.162671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:42513)
0812 00:03:05.162854 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:05.162899 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:05.163446 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:05.163795 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:05.163799 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:05.164432 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:05.164657 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:05.164662 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.165571 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.165572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:05.166747 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:05.166751 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.167297 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.167299 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:05.167451 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.168051 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:05.168063 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:05.170095 (+ 2032us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:05.171978 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:05.171990 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:05.171994 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:05.172452 (+ 458us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:05.172735 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:05.172737 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:05.172737 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:05.172950 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:05.173537 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:05.173552 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:05.173826 (+ 274us) client_negotiation.cc:769] Sending connection context
0812 00:03:05.174003 (+ 177us) client_negotiation.cc:240] Negotiation successful
0812 00:03:05.174231 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":101,"threads_started":1}
I20260812 00:03:05.175211 17392 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42771
I20260812 00:03:05.175345 17392 heartbeater.cc:464] Registering TS with master...
I20260812 00:03:05.175729 17392 heartbeater.cc:511] Master 127.25.103.126:42771 requested a full tablet report, sending...
I20260812 00:03:05.176266 16790 ts_manager.cc:194] Registered new tserver with Master: 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585)
I20260812 00:03:05.176662 16790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:42513
W20260812 00:03:05.268364 17395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:05.268659 17395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:05.268833 17395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:05.271925 17395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:05.272007 17395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:05.272054 17395 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:03:05.274745 17395 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:36711
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=34539
--tserver_master_addrs=127.25.103.126:42771
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17395
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:05.275110 17395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:05.275383 17395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:05.281333 17407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:05.281433 17404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:05.281613 17395 server_base.cc:1034] running on GCE node
W20260812 00:03:05.281750 17405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:05.282042 17395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:05.282401 17395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:05.283574 17395 hybrid_clock.cc:648] HybridClock initialized: now 1786492985283551 us; error 44 us; skew 500 ppm
Aug 12 00:03:05 dist-test-slave-vpvm krb5kdc[15732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492985, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:05.286958 17395 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:03:05.287528 17395 webserver.cc:460] Webserver started at http://127.25.103.67:34539/ using document root <none> and password file <none>
I20260812 00:03:05.287796 17395 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:05.287868 17395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:05.289505 17395 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:03:05.290647 17424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:05.291029 17395 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:03:05.291158 17395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "2c96c865f9464c7691793bc691bc444c"
format_stamp: "Formatted at 2026-08-12 00:03:04 on dist-test-slave-vpvm"
server_key: "5acb5f93734e7c1873f16fbde7a30581"
server_key_iv: "27fafc7aeee227bd237593ff958bba0c"
server_key_version: "encryptionkey@0"
I20260812 00:03:05.291769 17395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:05.310561 17395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:05.313160 17395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:05.313303 17395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:05.313565 17395 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:03:05.313910 17395 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:03:05.313944 17395 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:05.314018 17395 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:03:05.314043 17395 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:05.320679 17395 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:36711
I20260812 00:03:05.320776 17608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:36711 every 8 connection(s)
I20260812 00:03:05.321125 17395 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:03:05 dist-test-slave-vpvm krb5kdc[15732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492985, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:03:05.330554 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 17395
I20260812 00:03:05.333181 17142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.322268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:43189 (local address 127.25.103.126:42771)
0812 00:03:05.322372 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:05.322375 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:05.322578 (+ 203us) server_negotiation.cc:407] Connection header received
0812 00:03:05.323296 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:05.323297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:05.323313 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:05.323371 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:05.324556 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.325079 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.326430 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.326648 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.326714 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.329482 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:05.329484 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:05.329484 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:05.329492 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:05.331034 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:05.331561 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:05.331562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:05.331563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:05.331669 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:05.332058 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:05.332060 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:05.332061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:05.332440 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:05.332559 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:05.332889 (+ 330us) server_negotiation.cc:299] Negotiation successful
0812 00:03:05.333054 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 00:03:05.333284 17612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.322179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:43189)
0812 00:03:05.322401 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:05.322452 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:05.323137 (+ 685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:05.323450 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:05.323454 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:05.324096 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:05.324326 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:05.324333 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.325213 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.325214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:05.326281 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:05.326285 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.326738 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.326739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:05.326860 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.327419 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:05.327428 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:05.329328 (+ 1900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:05.331145 (+ 1817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:05.331157 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:05.331162 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:05.331460 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:05.331749 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:05.331750 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:05.331750 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:05.331919 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:05.332568 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:05.332574 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:05.332735 (+ 161us) client_negotiation.cc:769] Sending connection context
0812 00:03:05.332837 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 00:03:05.333004 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":84,"threads_started":1}
I20260812 00:03:05.333935 17610 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42771
I20260812 00:03:05.334102 17610 heartbeater.cc:464] Registering TS with master...
I20260812 00:03:05.334308 17610 heartbeater.cc:511] Master 127.25.103.126:42771 requested a full tablet report, sending...
I20260812 00:03:05.334897 16790 ts_manager.cc:194] Registered new tserver with Master: 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711)
I20260812 00:03:05.335306 16790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:43189
I20260812 00:03:05.339824 17616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.330994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54096 (local address 127.25.103.126:42771)
0812 00:03:05.331291 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:05.331293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:05.331306 (+ 13us) server_negotiation.cc:407] Connection header received
0812 00:03:05.331341 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:05.331342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:05.331356 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:05.331462 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:05.332255 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.333006 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.334247 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.334551 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.334643 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.336585 (+ 1942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:05.336587 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:05.336587 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:05.336597 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:05.338339 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:05.338839 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:05.338840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:05.338841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:05.338917 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:05.339155 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:05.339156 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:05.339156 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:05.339288 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:05.339435 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:05.339609 (+ 174us) server_negotiation.cc:299] Negotiation successful
0812 00:03:05.339734 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":104,"threads_started":1}
I20260812 00:03:05.340734 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:03:05.344189 17616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.341098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54098 (local address 127.25.103.126:42771)
0812 00:03:05.341146 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:05.341148 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:05.341239 (+ 91us) server_negotiation.cc:407] Connection header received
0812 00:03:05.341305 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:05.341306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:05.341339 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:05.341394 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:03:05.341590 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.342181 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.342990 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.343217 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.343281 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.343669 (+ 388us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:03:05.343869 (+ 200us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:03:05.343966 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:05.344090 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 00:03:05.344123 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:03:05.344579 16790 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:54098:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:03:05.346355 16790 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:03:05.348608 17018 tablet_service.cc:1467] Processing CreateTablet for tablet 3a5a3df3b1a5490e852f9e8233514289 (DEFAULT_TABLE table=test-table [id=2322a9b54e8e4ecaa7e6c1255dc40831]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:03:05.348860 17018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a5a3df3b1a5490e852f9e8233514289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:05.350526 16931 tablet_bootstrap.cc:492] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317: Bootstrap starting.
I20260812 00:03:05.351084 16931 tablet_bootstrap.cc:654] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:05.352063 16931 tablet_bootstrap.cc:492] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317: No bootstrap required, opened a new log
I20260812 00:03:05.352123 16931 ts_tablet_manager.cc:1397] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:03:05.352371 16931 raft_consensus.cc:348] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:05.352473 16931 raft_consensus.cc:374] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:05.352522 16931 raft_consensus.cc:729] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bab7efac44dea914aecf2a7422317, State: Initialized, Role: FOLLOWER
I20260812 00:03:05.352571 16931 consensus_queue.cc:260] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:05.352676 16931 ts_tablet_manager.cc:1428] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 00:03:05.353933 17160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.348388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:33585 (local address 127.0.0.1:59264)
0812 00:03:05.348442 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:05.348455 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:05.348504 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:05.350630 (+ 2126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:05.350631 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:05.350634 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:05.350690 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:05.350692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.351563 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.351564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:05.352638 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:05.352642 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.353557 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.353558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:05.353651 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.353680 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 00:03:05.353766 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 00:03:05.353846 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 00:03:05.354050 17620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.348502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59264 (local address 127.25.103.66:33585)
0812 00:03:05.350477 (+ 1975us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:05.350481 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:05.350492 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:03:05.350533 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:05.350534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:05.350548 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:05.350621 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:05.350757 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.351462 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.352750 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.353460 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.353555 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.353634 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:05.353850 (+ 216us) server_negotiation.cc:299] Negotiation successful
0812 00:03:05.353905 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1928,"thread_start_us":140,"threads_started":1}
I20260812 00:03:05.355031 17277 tablet_service.cc:1467] Processing CreateTablet for tablet 3a5a3df3b1a5490e852f9e8233514289 (DEFAULT_TABLE table=test-table [id=2322a9b54e8e4ecaa7e6c1255dc40831]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:03:05.355538 17277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a5a3df3b1a5490e852f9e8233514289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:05.355605 17622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.348746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60186 (local address 127.25.103.67:36711)
0812 00:03:05.348943 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:05.348948 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:05.348959 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:03:05.349008 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:05.349010 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:05.349024 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:05.349101 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:05.349249 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.350272 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.354004 (+ 3732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.355073 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.355128 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.355194 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:05.355455 (+ 261us) server_negotiation.cc:299] Negotiation successful
0812 00:03:05.355511 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":95,"threads_started":1}
I20260812 00:03:05.356007 17619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.348526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:36711 (local address 127.0.0.1:60186)
0812 00:03:05.348639 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:05.348647 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:05.348686 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:05.349119 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:05.349121 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:05.349123 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:05.349184 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:05.349186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.351852 (+ 2666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.351854 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:05.353838 (+ 1984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:05.353842 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.355280 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.355281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:05.355354 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.355359 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:03:05.355731 (+ 372us) client_negotiation.cc:240] Negotiation successful
0812 00:03:05.355907 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":75,"threads_started":1}
I20260812 00:03:05.356909 17494 tablet_service.cc:1467] Processing CreateTablet for tablet 3a5a3df3b1a5490e852f9e8233514289 (DEFAULT_TABLE table=test-table [id=2322a9b54e8e4ecaa7e6c1255dc40831]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:03:05.357247 17494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a5a3df3b1a5490e852f9e8233514289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:05.360322 17625 tablet_bootstrap.cc:492] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d: Bootstrap starting.
I20260812 00:03:05.361155 17625 tablet_bootstrap.cc:654] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:05.361339 17626 tablet_bootstrap.cc:492] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c: Bootstrap starting.
I20260812 00:03:05.361807 17625 log.cc:824] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:05.362130 17626 tablet_bootstrap.cc:654] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:05.362645 17626 log.cc:824] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:05.362807 17625 tablet_bootstrap.cc:492] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d: No bootstrap required, opened a new log
I20260812 00:03:05.362887 17625 ts_tablet_manager.cc:1397] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:03:05.363502 17626 tablet_bootstrap.cc:492] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c: No bootstrap required, opened a new log
I20260812 00:03:05.363591 17626 ts_tablet_manager.cc:1397] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:03:05.365005 17625 raft_consensus.cc:348] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:05.365221 17625 raft_consensus.cc:374] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:05.365267 17625 raft_consensus.cc:729] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d638206fc0c436f9f783f7193605f9d, State: Initialized, Role: FOLLOWER
I20260812 00:03:05.365440 17625 consensus_queue.cc:260] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:05.365748 17625 ts_tablet_manager.cc:1428] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:03:05.365675 17626 raft_consensus.cc:348] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:05.365780 17392 heartbeater.cc:503] Master 127.25.103.126:42771 was elected leader, sending a full tablet report...
I20260812 00:03:05.365844 17626 raft_consensus.cc:374] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:05.365886 17626 raft_consensus.cc:729] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c96c865f9464c7691793bc691bc444c, State: Initialized, Role: FOLLOWER
I20260812 00:03:05.366025 17626 consensus_queue.cc:260] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:05.366322 17626 ts_tablet_manager.cc:1428] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:03:05.366344 17610 heartbeater.cc:503] Master 127.25.103.126:42771 was elected leader, sending a full tablet report...
I20260812 00:03:05.367949 17152 raft_consensus.cc:482] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:03:05.368101 17152 raft_consensus.cc:504] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:05.368618 17152 leader_election.cc:288] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585), 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711)
I20260812 00:03:05.373062 17622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.368946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:33487 (local address 127.25.103.67:36711)
0812 00:03:05.368991 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:05.368994 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:05.369106 (+ 112us) server_negotiation.cc:407] Connection header received
0812 00:03:05.369187 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:05.369188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:05.369197 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:05.369238 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:05.369541 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.370338 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.371950 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.372565 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.372641 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.372651 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:05.372961 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 00:03:05.373004 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:03:05.373037 17620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.368857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:36275 (local address 127.25.103.66:33585)
0812 00:03:05.368918 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:05.368920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:05.369100 (+ 180us) server_negotiation.cc:407] Connection header received
0812 00:03:05.369186 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:05.369187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:05.369196 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:05.369241 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:05.369429 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.370301 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.371951 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.372558 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.372641 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.372651 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:05.372901 (+ 250us) server_negotiation.cc:299] Negotiation successful
0812 00:03:05.372947 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:03:05.373070 17141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.368775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:33585 (local address 127.25.103.65:36275)
0812 00:03:05.369029 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:05.369039 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:05.369108 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:05.369251 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:05.369252 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:05.369253 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:05.369351 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:05.369352 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.370438 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.370439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:05.371836 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:05.371840 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.372670 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.372672 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:05.372767 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.372805 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 00:03:05.372893 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 00:03:05.372956 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":79}
I20260812 00:03:05.373082 17636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.368870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:36711 (local address 127.25.103.65:33487)
0812 00:03:05.369034 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:05.369043 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:05.369110 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:05.369242 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:05.369243 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:05.369244 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:05.369342 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:05.369345 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.370438 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.370439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:05.371836 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:05.371840 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.372670 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.372672 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:05.372767 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.372805 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 00:03:05.372919 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 00:03:05.372956 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":75,"thread_start_us":115,"threads_started":1}
I20260812 00:03:05.373577 17526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a5a3df3b1a5490e852f9e8233514289" candidate_uuid: "4f3bab7efac44dea914aecf2a7422317" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c96c865f9464c7691793bc691bc444c" is_pre_election: true
I20260812 00:03:05.373741 17526 raft_consensus.cc:2454] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bab7efac44dea914aecf2a7422317 in term 0.
I20260812 00:03:05.373976 17307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a5a3df3b1a5490e852f9e8233514289" candidate_uuid: "4f3bab7efac44dea914aecf2a7422317" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d638206fc0c436f9f783f7193605f9d" is_pre_election: true
I20260812 00:03:05.374150 17307 raft_consensus.cc:2454] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bab7efac44dea914aecf2a7422317 in term 0.
I20260812 00:03:05.374228 16919 leader_election.cc:302] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c96c865f9464c7691793bc691bc444c, 4f3bab7efac44dea914aecf2a7422317; no voters:
I20260812 00:03:05.374432 17152 raft_consensus.cc:2781] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:03:05.374532 17152 raft_consensus.cc:482] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:03:05.374559 17152 raft_consensus.cc:3037] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:03:05.375471 17152 raft_consensus.cc:504] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:05.375626 17152 leader_election.cc:288] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 1 election: Requested vote from peers 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585), 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711)
I20260812 00:03:05.375862 17307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a5a3df3b1a5490e852f9e8233514289" candidate_uuid: "4f3bab7efac44dea914aecf2a7422317" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d638206fc0c436f9f783f7193605f9d"
I20260812 00:03:05.375946 17307 raft_consensus.cc:3037] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:03:05.375941 17526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a5a3df3b1a5490e852f9e8233514289" candidate_uuid: "4f3bab7efac44dea914aecf2a7422317" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c96c865f9464c7691793bc691bc444c"
I20260812 00:03:05.376091 17526 raft_consensus.cc:3037] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:03:05.376799 17307 raft_consensus.cc:2454] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bab7efac44dea914aecf2a7422317 in term 1.
I20260812 00:03:05.377134 16919 leader_election.cc:302] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d638206fc0c436f9f783f7193605f9d, 4f3bab7efac44dea914aecf2a7422317; no voters:
I20260812 00:03:05.377286 17526 raft_consensus.cc:2454] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bab7efac44dea914aecf2a7422317 in term 1.
I20260812 00:03:05.377319 17152 raft_consensus.cc:2781] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:03:05.377554 17152 raft_consensus.cc:686] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 LEADER]: Becoming Leader. State: Replica: 4f3bab7efac44dea914aecf2a7422317, State: Running, Role: LEADER
I20260812 00:03:05.377647 17152 consensus_queue.cc:237] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:05.378731 16790 catalog_manager.cc:5495] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f3bab7efac44dea914aecf2a7422317 (127.25.103.65). New cstate: current_term: 1 leader_uuid: "4f3bab7efac44dea914aecf2a7422317" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } health_report { overall_health: HEALTHY } } }
I20260812 00:03:05.387106 17161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.384109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37596 (local address 127.25.103.65:38949)
0812 00:03:05.384185 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:05.384188 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:05.384200 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:03:05.384260 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:05.384261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:05.384289 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:05.384364 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:03:05.384549 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.385097 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.385902 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:05.386220 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:05.386290 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:05.386574 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:03:05.386836 (+ 262us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:03:05.386933 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:05.386981 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 00:03:05.387017 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 00:03:05.389144 17526 raft_consensus.cc:1261] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c [term 1 FOLLOWER]: Refusing update from remote peer 4f3bab7efac44dea914aecf2a7422317: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:03:05.389588 17307 raft_consensus.cc:1261] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d [term 1 FOLLOWER]: Refusing update from remote peer 4f3bab7efac44dea914aecf2a7422317: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:03:05.389698 17637 consensus_queue.cc:1035] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:03:05.390102 17152 consensus_queue.cc:1035] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:03:05.393142 17644 mvcc.cc:205] Tried to move back new op lower bound from 7317475268150419456 to 7317475268107681792. Current Snapshot: MvccSnapshot[applied={T|T < 7317475268150419456}]
I20260812 00:03:05.394081 17640 mvcc.cc:205] Tried to move back new op lower bound from 7317475268150419456 to 7317475268107681792. Current Snapshot: MvccSnapshot[applied={T|T < 7317475268150419456 or (T in {7317475268150419456})}]
I20260812 00:03:05.395865 16790 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:54098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:03:05.395968 16790 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:54098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:03:05.396703 16790 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78: Sending DeleteTablet for 3 replicas of tablet 3a5a3df3b1a5490e852f9e8233514289
I20260812 00:03:05.397029 17018 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a5a3df3b1a5490e852f9e8233514289 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:03:05 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:37586
I20260812 00:03:05.397131 17162 tablet_replica.cc:330] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317: stopping tablet replica
I20260812 00:03:05.397100 17277 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a5a3df3b1a5490e852f9e8233514289 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:03:05 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:59264
I20260812 00:03:05.397104 17494 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a5a3df3b1a5490e852f9e8233514289 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:03:05 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:60186
I20260812 00:03:05.397178 17162 raft_consensus.cc:2229] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:03:05.397280 17162 raft_consensus.cc:2258] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:03:05.397531 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 16854
I20260812 00:03:05.413740 17659 tablet_replica.cc:330] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d: stopping tablet replica
I20260812 00:03:05.413893 17659 raft_consensus.cc:2229] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:03:05.414053 17659 raft_consensus.cc:2258] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:03:05.414220 17662 tablet_replica.cc:330] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c: stopping tablet replica
I20260812 00:03:05.414320 17662 raft_consensus.cc:2229] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:03:05.414398 17662 raft_consensus.cc:2258] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:03:05.418799 17662 ts_tablet_manager.cc:1905] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:03:05.418910 17659 ts_tablet_manager.cc:1905] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:03:05.420907 17659 ts_tablet_manager.cc:1918] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:03:05.420907 17662 ts_tablet_manager.cc:1918] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:03:05.421025 17662 log.cc:1196] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/3a5a3df3b1a5490e852f9e8233514289
I20260812 00:03:05.421027 17659 log.cc:1196] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/3a5a3df3b1a5490e852f9e8233514289
I20260812 00:03:05.421344 17662 ts_tablet_manager.cc:1939] T 3a5a3df3b1a5490e852f9e8233514289 P 2c96c865f9464c7691793bc691bc444c: Deleting consensus metadata
I20260812 00:03:05.421355 17659 ts_tablet_manager.cc:1939] T 3a5a3df3b1a5490e852f9e8233514289 P 0d638206fc0c436f9f783f7193605f9d: Deleting consensus metadata
I20260812 00:03:05.421885 16767 catalog_manager.cc:4841] TS 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711): tablet 3a5a3df3b1a5490e852f9e8233514289 (table test-table [id=2322a9b54e8e4ecaa7e6c1255dc40831]) successfully deleted
I20260812 00:03:05.422092 16767 catalog_manager.cc:4841] TS 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585): tablet 3a5a3df3b1a5490e852f9e8233514289 (table test-table [id=2322a9b54e8e4ecaa7e6c1255dc40831]) successfully deleted
W20260812 00:03:05.423533 16773 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.103.65:38949 (error 108)
I20260812 00:03:05.423869 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 17148
I20260812 00:03:05.424042 17619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.423902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:38949 (local address 127.0.0.1:37602)
0812 00:03:05.423969 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:05.424007 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:38949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 00:03:05.427093 16773 catalog_manager.cc:4584] TS 4f3bab7efac44dea914aecf2a7422317 (127.25.103.65:38949): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3a5a3df3b1a5490e852f9e8233514289: Network error: Client connection negotiation failed: client connection to 127.25.103.65:38949: connect: Connection refused (error 111)
I20260812 00:03:05.433422 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 17395
I20260812 00:03:05.450793 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 16733
I20260812 00:03:05.472259 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:42771
--webserver_interface=127.25.103.126
--webserver_port=44637
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:42771
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:03:05.568354 17664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:05.568622 17664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:05.568648 17664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:05.570796 17664 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:03:05.570907 17664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:05.570923 17664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:05.570937 17664 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:03:05.570950 17664 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:03:05.573163 17664 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:42771
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:42771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=44637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:05.573505 17664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:05.573808 17664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:05.580129 17671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:05.580129 17677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:05.580156 17664 server_base.cc:1034] running on GCE node
W20260812 00:03:05.580135 17672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:05.580638 17664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:05.580988 17664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:05.582159 17664 hybrid_clock.cc:648] HybridClock initialized: now 1786492985582139 us; error 38 us; skew 500 ppm
Aug 12 00:03:05 dist-test-slave-vpvm krb5kdc[15732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492985, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:05.585793 17664 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:03:05.586589 17664 webserver.cc:460] Webserver started at http://127.25.103.126:44637/ using document root <none> and password file <none>
I20260812 00:03:05.586942 17664 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:05.587001 17664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:05.588792 17664 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:03:05.589772 17691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:05.590066 17664 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:03:05.590186 17664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "f7c7742675c14024b02710088a902e78"
format_stamp: "Formatted at 2026-08-12 00:03:03 on dist-test-slave-vpvm"
server_key: "3eb2d26c4732dac8eb0d8d31c5a58a07"
server_key_iv: "6547a33835e52cdf9a64f28d8b2f5768"
server_key_version: "encryptionkey@0"
I20260812 00:03:05.590646 17664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:05.633895 17664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:05.636880 17664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:05.637059 17664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:05.641546 17664 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:42771
I20260812 00:03:05.641647 17777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:42771 every 8 connection(s)
I20260812 00:03:05.642098 17664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:03:05.643965 17778 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:03:05.644722 17778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78: Bootstrap starting.
I20260812 00:03:05.650576 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 17664
I20260812 00:03:05.650867 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:38949
--local_ip_for_outbound_sockets=127.25.103.65
--tserver_master_addrs=127.25.103.126:42771
--webserver_port=44369
--webserver_interface=127.25.103.65
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:03:05.656081 17778 log.cc:824] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:05.659328 17778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:03:05.659714 17778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78: Bootstrap complete.
I20260812 00:03:05.662217 17778 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c7742675c14024b02710088a902e78" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42771 } }
I20260812 00:03:05.662485 17778 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c7742675c14024b02710088a902e78, State: Initialized, Role: FOLLOWER
I20260812 00:03:05.662644 17778 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c7742675c14024b02710088a902e78" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42771 } }
I20260812 00:03:05.662724 17778 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:03:05.662770 17778 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:03:05.662823 17778 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 2 FOLLOWER]: Advancing to term 3
I20260812 00:03:05.663968 17778 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c7742675c14024b02710088a902e78" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42771 } }
I20260812 00:03:05.664083 17778 leader_election.cc:302] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7c7742675c14024b02710088a902e78; no voters:
I20260812 00:03:05.664271 17778 leader_election.cc:288] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 00:03:05.664326 17782 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 00:03:05.664448 17782 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [term 3 LEADER]: Becoming Leader. State: Replica: f7c7742675c14024b02710088a902e78, State: Running, Role: LEADER
I20260812 00:03:05.664582 17778 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:03:05.664718 17782 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c7742675c14024b02710088a902e78" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42771 } }
I20260812 00:03:05.665038 17787 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "f7c7742675c14024b02710088a902e78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c7742675c14024b02710088a902e78" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42771 } } }
I20260812 00:03:05.665153 17787 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [sys.catalog]: This master's current role is: LEADER
I20260812 00:03:05.665053 17788 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7c7742675c14024b02710088a902e78. Latest consensus state: current_term: 3 leader_uuid: "f7c7742675c14024b02710088a902e78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c7742675c14024b02710088a902e78" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42771 } } }
I20260812 00:03:05.665324 17788 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7c7742675c14024b02710088a902e78 [sys.catalog]: This master's current role is: LEADER
I20260812 00:03:05.665357 17802 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:03:05.666428 17802 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:03:05.666544 17802 catalog_manager.cc:1259] Loaded cluster ID: c72639eda8aa4fe2807d5ec70ebff153
I20260812 00:03:05.666877 17802 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 00:03:05.667359 17802 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7ff6e9e1e9ad google::LogMessage::Fail() at ??:0
@ 0x7ff6e9e2188a google::LogMessage::SendToLog() at ??:0
@ 0x7ff6e9e1e4de google::LogMessage::Flush() at ??:0
@ 0x7ff6e9e1fa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7ff6f1d430f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7ff6f1d4c8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7ff6ebcec0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7ff6ebce1954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7ff6ecb456db start_thread at ??:0
@ 0x7ff6e891c61f clone at ??:0
W20260812 00:03:05.758245 17780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:05.758474 17780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:05.758502 17780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:05.759799 17780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:05.759850 17780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:05.759878 17780 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:03:05.761722 17780 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:38949
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=44369
--tserver_master_addrs=127.25.103.126:42771
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17780
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:05.762176 17780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:05.762521 17780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:05.768680 17834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:05.768680 17835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:05.769066 17842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:05.769321 17780 server_base.cc:1034] running on GCE node
I20260812 00:03:05.769559 17780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:05.769851 17780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:05.771061 17780 hybrid_clock.cc:648] HybridClock initialized: now 1786492985771049 us; error 40 us; skew 500 ppm
Aug 12 00:03:05 dist-test-slave-vpvm krb5kdc[15732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492985, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:05.773929 17780 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:03:05.774519 17780 webserver.cc:460] Webserver started at http://127.25.103.65:44369/ using document root <none> and password file <none>
I20260812 00:03:05.774780 17780 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:05.774835 17780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:05.776597 17780 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:03:05.777542 17859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:05.777737 17780 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:05.777848 17780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "4f3bab7efac44dea914aecf2a7422317"
format_stamp: "Formatted at 2026-08-12 00:03:03 on dist-test-slave-vpvm"
server_key: "e3904a53219ef8960c2b6d7e6e82ee62"
server_key_iv: "03573be08b5d2ebdb5418f012ec754ab"
server_key_version: "encryptionkey@0"
I20260812 00:03:05.778405 17780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:05.822481 17780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:05.826066 17780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:05.826241 17780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:05.826502 17780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:03:05.826989 17870 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 00:03:05.829082 17780 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 00:03:05.829161 17780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 00:03:05.829203 17780 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 00:03:05.830657 17780 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 00:03:05.830713 17780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.001s
I20260812 00:03:05.830811 17870 tablet_bootstrap.cc:492] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317: Bootstrap starting.
I20260812 00:03:05.837281 17780 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:38949
I20260812 00:03:05.837442 18055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:38949 every 8 connection(s)
I20260812 00:03:05.837752 17780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:03:05.838692 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 17780
I20260812 00:03:05.839128 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:33585
--local_ip_for_outbound_sockets=127.25.103.66
--tserver_master_addrs=127.25.103.126:42771
--webserver_port=44877
--webserver_interface=127.25.103.66
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:03:05.844646 17870 log.cc:824] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:05.848734 17870 tablet_bootstrap.cc:492] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:03:05.849169 17870 tablet_bootstrap.cc:492] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317: Bootstrap complete.
I20260812 00:03:05.850443 17870 ts_tablet_manager.cc:1397] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.016s
I20260812 00:03:05.852061 17870 raft_consensus.cc:348] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:05.852428 17870 raft_consensus.cc:729] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bab7efac44dea914aecf2a7422317, State: Initialized, Role: FOLLOWER
I20260812 00:03:05.852624 17870 consensus_queue.cc:260] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:05.852975 17870 ts_tablet_manager.cc:1428] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
W20260812 00:03:05.912097 18060 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:03:05.838563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:60203)
0812 00:03:05.839139 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:05.839415 (+ 276us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:05.841292 (+ 1877us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:05.911875 (+ 70583us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":116,"threads_started":1}
W20260812 00:03:05.912352 18058 heartbeater.cc:644] Failed to heartbeat to 127.25.103.126:42771 (0 consecutive failures): Network error: Failed to ping master at 127.25.103.126:42771: Client connection negotiation failed: client connection to 127.25.103.126:42771: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:03:05.913028 18060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.912855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:58135)
0812 00:03:05.912943 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:05.912997 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 00:03:05.913429 18060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.913336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:59481)
0812 00:03:05.913373 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:05.913412 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260812 00:03:05.913545 18058 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:03:05.938244 18061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:05.938786 18061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:05.938897 18061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:05.940450 18061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:05.940518 18061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:05.940563 18061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:03:05.942392 18061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:33585
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=44877
--tserver_master_addrs=127.25.103.126:42771
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:05.942673 18061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:05.942924 18061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:05.949337 18072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:05.949340 18078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:05.949335 18074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:05.949858 18061 server_base.cc:1034] running on GCE node
I20260812 00:03:05.950141 18061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:05.950417 18061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:05.951613 18061 hybrid_clock.cc:648] HybridClock initialized: now 1786492985951585 us; error 71 us; skew 500 ppm
Aug 12 00:03:05 dist-test-slave-vpvm krb5kdc[15732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492985, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:05.954468 18061 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:03:05.954994 18061 webserver.cc:460] Webserver started at http://127.25.103.66:44877/ using document root <none> and password file <none>
I20260812 00:03:05.955216 18061 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:05.955271 18061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:05.956912 18061 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:05.957870 18088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:05.958174 18061 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:05.958288 18061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "0d638206fc0c436f9f783f7193605f9d"
format_stamp: "Formatted at 2026-08-12 00:03:04 on dist-test-slave-vpvm"
server_key: "9efba861fcb08a4ecbf7e322ffe77e1c"
server_key_iv: "60d728e116fd5009906c47e1bed4a6cf"
server_key_version: "encryptionkey@0"
I20260812 00:03:05.958801 18061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:05.979368 18061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:05.982430 18061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:05.982596 18061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:05.982853 18061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:03:05.983217 18061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:03:05.983253 18061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:05.983283 18061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:03:05.983310 18061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:05.990887 18061 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:33585
I20260812 00:03:05.990990 18300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:33585 every 8 connection(s)
I20260812 00:03:05.991605 18061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:03:05.993247 18304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.992519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:60427)
0812 00:03:05.992757 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:05.992863 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":105,"threads_started":1}
W20260812 00:03:05.993568 18301 heartbeater.cc:644] Failed to heartbeat to 127.25.103.126:42771 (0 consecutive failures): Network error: Failed to ping master at 127.25.103.126:42771: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
I20260812 00:03:05.994019 18304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.993836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:58711)
0812 00:03:05.993915 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:05.993991 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 00:03:05.994510 18304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:05.994419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:35097)
0812 00:03:05.994462 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:05.994489 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260812 00:03:05.994642 18301 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:03:05.999019 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 18061
I20260812 00:03:05.999264 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:36711
--local_ip_for_outbound_sockets=127.25.103.67
--tserver_master_addrs=127.25.103.126:42771
--webserver_port=34539
--webserver_interface=127.25.103.67
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:03:06.091038 18306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:06.091289 18306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:06.091318 18306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:06.093688 18306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:06.093777 18306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:06.093812 18306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:03:06.096060 18306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:36711
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=34539
--tserver_master_addrs=127.25.103.126:42771
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:06.096395 18306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:06.096707 18306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:06.103350 18318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:06.103349 18315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:06.103372 18316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:06.103906 18306 server_base.cc:1034] running on GCE node
I20260812 00:03:06.104144 18306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:06.104429 18306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:06.105615 18306 hybrid_clock.cc:648] HybridClock initialized: now 1786492986105573 us; error 65 us; skew 500 ppm
Aug 12 00:03:06 dist-test-slave-vpvm krb5kdc[15732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492986, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:06.109179 18306 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:03:06.109824 18306 webserver.cc:460] Webserver started at http://127.25.103.67:34539/ using document root <none> and password file <none>
I20260812 00:03:06.110124 18306 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:06.110350 18306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:06.112205 18306 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:03:06.113196 18327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:06.113543 18306 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:06.113662 18306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "2c96c865f9464c7691793bc691bc444c"
format_stamp: "Formatted at 2026-08-12 00:03:04 on dist-test-slave-vpvm"
server_key: "5acb5f93734e7c1873f16fbde7a30581"
server_key_iv: "27fafc7aeee227bd237593ff958bba0c"
server_key_version: "encryptionkey@0"
I20260812 00:03:06.114248 18306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:06.149341 18306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:06.152127 18306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:06.152297 18306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:06.152583 18306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:03:06.152940 18306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:03:06.152978 18306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:06.153010 18306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:03:06.153028 18306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:06.160190 18306 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:36711
I20260812 00:03:06.160245 18511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:36711 every 8 connection(s)
I20260812 00:03:06.160652 18306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:03:06.162125 18516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:06.161406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:37721)
0812 00:03:06.161658 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:06.161848 (+ 190us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":84,"threads_started":1}
W20260812 00:03:06.162752 18512 heartbeater.cc:644] Failed to heartbeat to 127.25.103.126:42771 (0 consecutive failures): Network error: Failed to ping master at 127.25.103.126:42771: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
I20260812 00:03:06.163185 18516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:06.163052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:35625)
0812 00:03:06.163111 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:06.163157 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 00:03:06.163450 18516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:06.163375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:49521)
0812 00:03:06.163411 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:06.163435 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260812 00:03:06.163547 18512 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:03:06.166544 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 18306
I20260812 00:03:06.914391 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:06.914094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:43733)
0812 00:03:06.914263 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:06.914314 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":89,"threads_started":1}
I20260812 00:03:06.995462 18523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:06.995054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:44269)
0812 00:03:06.995284 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:06.995360 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":71,"threads_started":1}
I20260812 00:03:07.164307 18524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:07.163992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:52997)
0812 00:03:07.164186 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:07.164235 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":94,"threads_started":1}
I20260812 00:03:07.244906 18526 raft_consensus.cc:482] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:03:07.245067 18526 raft_consensus.cc:504] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:07.245410 18526 leader_election.cc:288] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585), 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711)
Aug 12 00:03:07 dist-test-slave-vpvm krb5kdc[15732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492985, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.67@KRBTEST.COM
Aug 12 00:03:07 dist-test-slave-vpvm krb5kdc[15732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492985, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.66@KRBTEST.COM
I20260812 00:03:07.258276 18534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:07.245973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:33713 (local address 127.25.103.67:36711)
0812 00:03:07.246095 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:07.246102 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:07.246129 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:03:07.246578 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:07.246580 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:07.246618 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:07.246747 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:07.247496 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:07.248442 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:07.249587 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:07.250415 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:07.250549 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:07.253586 (+ 3037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:07.253593 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:07.253593 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:07.253612 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:07.256047 (+ 2435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:07.256749 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:07.256753 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:07.256753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:07.256905 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:07.257227 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:07.257228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:07.257228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:07.257566 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:07.257634 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:07.257994 (+ 360us) server_negotiation.cc:299] Negotiation successful
0812 00:03:07.258149 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":45,"threads_started":1}
I20260812 00:03:07.258276 18532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:07.245788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:38299 (local address 127.25.103.66:33585)
0812 00:03:07.246037 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:07.246047 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:07.246077 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:03:07.246530 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:07.246532 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:07.246574 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:07.246694 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:07.247490 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:07.248463 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:07.249650 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:07.250188 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:07.250359 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:07.253994 (+ 3635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:07.253999 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:07.253999 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:07.254013 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:07.256572 (+ 2559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:07.257000 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:07.257003 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:07.257004 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:07.257119 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:07.257335 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:07.257336 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:07.257336 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:07.257608 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:07.257685 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:07.257943 (+ 258us) server_negotiation.cc:299] Negotiation successful
0812 00:03:07.258139 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":110,"threads_started":1}
I20260812 00:03:07.258282 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:07.245637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:33585 (local address 127.25.103.65:38299)
0812 00:03:07.245712 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:07.245729 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:07.245811 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:07.246773 (+ 962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:07.246776 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:07.247161 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:07.247367 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:07.247374 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:07.248561 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:07.248562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:07.249407 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:07.249409 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:07.250383 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:07.250385 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:07.250549 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:07.251317 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:07.251322 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:07.253838 (+ 2516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:07.256692 (+ 2854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:07.256694 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:07.256694 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:07.256914 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:07.257200 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:07.257201 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:07.257201 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:07.257275 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:07.257689 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:07.257690 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:07.257786 (+ 96us) client_negotiation.cc:769] Sending connection context
0812 00:03:07.257871 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 00:03:07.258147 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":108}
I20260812 00:03:07.258369 18530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:07.245750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:36711 (local address 127.25.103.65:33713)
0812 00:03:07.245854 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:07.245865 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:07.245924 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:07.246785 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:07.246786 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:07.247162 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:07.247368 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:07.247374 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:07.248539 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:07.248541 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:07.249409 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:07.249412 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:07.250569 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:07.250571 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:07.250644 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:07.251285 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:07.251298 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:07.253375 (+ 2077us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:07.256168 (+ 2793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:07.256181 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:07.256184 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:07.256641 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:07.256989 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:07.256990 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:07.256990 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:07.257152 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:07.257640 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:07.257648 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:07.257786 (+ 138us) client_negotiation.cc:769] Sending connection context
0812 00:03:07.257874 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 00:03:07.258227 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"mutex_wait_us":164,"thread_start_us":50,"threads_started":1}
W20260812 00:03:07.259847 17863 leader_election.cc:341] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711): Not found: Tablet not found: 3a5a3df3b1a5490e852f9e8233514289
W20260812 00:03:07.259933 17863 leader_election.cc:341] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585): Not found: Tablet not found: 3a5a3df3b1a5490e852f9e8233514289
I20260812 00:03:07.259950 17863 leader_election.cc:302] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bab7efac44dea914aecf2a7422317; no voters: 0d638206fc0c436f9f783f7193605f9d, 2c96c865f9464c7691793bc691bc444c
I20260812 00:03:07.260049 18526 raft_consensus.cc:2726] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:03:07.915266 18535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:07.914987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:60861)
0812 00:03:07.915156 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:07.915212 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":76,"threads_started":1}
I20260812 00:03:07.996616 18537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:07.996202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:53659)
0812 00:03:07.996497 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:07.996552 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":243,"threads_started":1}
I20260812 00:03:08.165251 18538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:08.164955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:37265)
0812 00:03:08.165141 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:08.165195 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":88,"threads_started":1}
I20260812 00:03:08.916183 18543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:08.915887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:57361)
0812 00:03:08.916074 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:08.916132 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":80,"threads_started":1}
I20260812 00:03:08.997740 18545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:08.997215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:58061)
0812 00:03:08.997635 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:08.997682 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":190,"threads_started":1}
I20260812 00:03:09.166255 18547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:09.165985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:58915)
0812 00:03:09.166153 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:09.166203 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":96,"threads_started":1}
I20260812 00:03:09.459698 18550 raft_consensus.cc:482] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:03:09.459846 18550 raft_consensus.cc:504] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:09.460021 18550 leader_election.cc:288] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585), 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711)
W20260812 00:03:09.460481 17863 leader_election.cc:341] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585): Not found: Tablet not found: 3a5a3df3b1a5490e852f9e8233514289
W20260812 00:03:09.460552 17863 leader_election.cc:341] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711): Not found: Tablet not found: 3a5a3df3b1a5490e852f9e8233514289
I20260812 00:03:09.460567 17863 leader_election.cc:302] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bab7efac44dea914aecf2a7422317; no voters: 0d638206fc0c436f9f783f7193605f9d, 2c96c865f9464c7691793bc691bc444c
I20260812 00:03:09.460630 18550 raft_consensus.cc:2726] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:03:09.917140 18552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:09.916834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:37327)
0812 00:03:09.917037 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:09.917087 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":77,"threads_started":1}
I20260812 00:03:09.998919 18553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:09.998599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:37853)
0812 00:03:09.998797 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:09.998852 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":85,"threads_started":1}
I20260812 00:03:10.167196 18554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:10.166902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:55605)
0812 00:03:10.167094 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:10.167144 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":94,"threads_started":1}
I20260812 00:03:10.918397 18555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:10.918068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:46611)
0812 00:03:10.918271 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:10.918341 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":92,"threads_started":1}
I20260812 00:03:10.999881 18556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:10.999586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:54915)
0812 00:03:10.999777 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:10.999824 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":72,"threads_started":1}
I20260812 00:03:11.168108 18558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:11.167831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:46531)
0812 00:03:11.168003 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:11.168053 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":75,"threads_started":1}
I20260812 00:03:11.919342 18559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:11.919061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:44863)
0812 00:03:11.919232 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:11.919289 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":75,"threads_started":1}
I20260812 00:03:12.000895 18561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:12.000520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:49573)
0812 00:03:12.000749 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:12.000824 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":75,"threads_started":1}
I20260812 00:03:12.018819 18562 raft_consensus.cc:482] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:03:12.018953 18562 raft_consensus.cc:504] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:12.019136 18562 leader_election.cc:288] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585), 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711)
W20260812 00:03:12.019758 17863 leader_election.cc:341] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711): Not found: Tablet not found: 3a5a3df3b1a5490e852f9e8233514289
W20260812 00:03:12.019829 17863 leader_election.cc:341] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585): Not found: Tablet not found: 3a5a3df3b1a5490e852f9e8233514289
I20260812 00:03:12.019843 17863 leader_election.cc:302] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bab7efac44dea914aecf2a7422317; no voters: 0d638206fc0c436f9f783f7193605f9d, 2c96c865f9464c7691793bc691bc444c
I20260812 00:03:12.019946 18562 raft_consensus.cc:2726] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:03:12.169575 18563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:12.168977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:47377)
0812 00:03:12.169324 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:12.169375 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":190,"threads_started":1}
I20260812 00:03:12.920459 18564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:12.920046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:36061)
0812 00:03:12.920334 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:12.920392 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":160,"threads_started":1}
I20260812 00:03:13.001920 18565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:13.001633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:46877)
0812 00:03:13.001811 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:13.001864 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":85,"threads_started":1}
I20260812 00:03:13.170663 18566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:13.170353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:52847)
0812 00:03:13.170545 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:13.170591 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":98,"threads_started":1}
I20260812 00:03:13.921325 18570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:13.921041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:40431)
0812 00:03:13.921213 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:13.921272 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":81,"threads_started":1}
I20260812 00:03:14.002800 18571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:14.002540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:57097)
0812 00:03:14.002696 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:14.002747 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":70,"threads_started":1}
I20260812 00:03:14.095316 18574 raft_consensus.cc:482] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:03:14.095454 18574 raft_consensus.cc:504] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:14.095695 18574 leader_election.cc:288] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585), 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711)
W20260812 00:03:14.096242 17863 leader_election.cc:341] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711): Not found: Tablet not found: 3a5a3df3b1a5490e852f9e8233514289
W20260812 00:03:14.096323 17863 leader_election.cc:341] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585): Not found: Tablet not found: 3a5a3df3b1a5490e852f9e8233514289
I20260812 00:03:14.096340 17863 leader_election.cc:302] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bab7efac44dea914aecf2a7422317; no voters: 0d638206fc0c436f9f783f7193605f9d, 2c96c865f9464c7691793bc691bc444c
I20260812 00:03:14.096590 18574 raft_consensus.cc:2726] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:03:14.172134 18576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:14.171770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:33037)
0812 00:03:14.171968 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:14.172015 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":91,"threads_started":1}
I20260812 00:03:14.922216 18577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:14.921931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:41831)
0812 00:03:14.922122 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:14.922168 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":99,"threads_started":1}
I20260812 00:03:15.003528 18578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:15.003273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:50275)
0812 00:03:15.003443 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:15.003480 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":84,"threads_started":1}
I20260812 00:03:15.173051 18579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:15.172788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:55059)
0812 00:03:15.172937 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:15.172979 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":86,"threads_started":1}
I20260812 00:03:15.923309 18580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:15.922883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:54073)
0812 00:03:15.923148 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:15.923233 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":115,"threads_started":1}
I20260812 00:03:16.004630 18581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:16.004250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:44455)
0812 00:03:16.004511 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:16.004578 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":123,"threads_started":1}
I20260812 00:03:16.173995 18583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:16.173683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:56945)
0812 00:03:16.173860 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:16.173901 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":97,"threads_started":1}
I20260812 00:03:16.205974 18585 raft_consensus.cc:482] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:03:16.206110 18585 raft_consensus.cc:504] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:16.206295 18585 leader_election.cc:288] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585), 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711)
W20260812 00:03:16.206820 17863 leader_election.cc:341] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711): Not found: Tablet not found: 3a5a3df3b1a5490e852f9e8233514289
W20260812 00:03:16.206890 17863 leader_election.cc:341] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585): Not found: Tablet not found: 3a5a3df3b1a5490e852f9e8233514289
I20260812 00:03:16.206913 17863 leader_election.cc:302] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bab7efac44dea914aecf2a7422317; no voters: 0d638206fc0c436f9f783f7193605f9d, 2c96c865f9464c7691793bc691bc444c
I20260812 00:03:16.206974 18585 raft_consensus.cc:2726] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:03:16.924546 18586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:16.924164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:37871)
0812 00:03:16.924415 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:16.924491 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":102,"threads_started":1}
I20260812 00:03:17.005604 18589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:17.005329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:38625)
0812 00:03:17.005507 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:17.005552 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":80,"threads_started":1}
I20260812 00:03:17.175114 18591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:17.174723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:35707)
0812 00:03:17.174978 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:17.175054 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":102,"threads_started":1}
I20260812 00:03:17.925501 18592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:17.925252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:40263)
0812 00:03:17.925393 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:17.925437 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":73,"threads_started":1}
I20260812 00:03:18.006717 18595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:18.006302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:60105)
0812 00:03:18.006573 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:18.006645 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":109,"threads_started":1}
I20260812 00:03:18.176200 18596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:18.175836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:48457)
0812 00:03:18.176077 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:18.176148 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":95,"threads_started":1}
I20260812 00:03:18.926476 18598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:18.926058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:52285)
0812 00:03:18.926314 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:18.926396 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":103,"threads_started":1}
I20260812 00:03:19.007809 18602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:19.007421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:50451)
0812 00:03:19.007656 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:19.007736 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":78,"threads_started":1}
I20260812 00:03:19.177134 18603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:19.176835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:46507)
0812 00:03:19.177013 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:19.177076 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":79,"threads_started":1}
I20260812 00:03:19.528784 18606 raft_consensus.cc:482] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:03:19.528911 18606 raft_consensus.cc:504] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d638206fc0c436f9f783f7193605f9d" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 33585 } } peers { permanent_uuid: "2c96c865f9464c7691793bc691bc444c" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36711 } } peers { permanent_uuid: "4f3bab7efac44dea914aecf2a7422317" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 38949 } }
I20260812 00:03:19.529094 18606 leader_election.cc:288] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585), 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711)
W20260812 00:03:19.529599 17863 leader_election.cc:341] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c96c865f9464c7691793bc691bc444c (127.25.103.67:36711): Not found: Tablet not found: 3a5a3df3b1a5490e852f9e8233514289
W20260812 00:03:19.529670 17863 leader_election.cc:341] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0d638206fc0c436f9f783f7193605f9d (127.25.103.66:33585): Not found: Tablet not found: 3a5a3df3b1a5490e852f9e8233514289
I20260812 00:03:19.529697 17863 leader_election.cc:302] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bab7efac44dea914aecf2a7422317; no voters: 0d638206fc0c436f9f783f7193605f9d, 2c96c865f9464c7691793bc691bc444c
I20260812 00:03:19.529779 18606 raft_consensus.cc:2726] T 3a5a3df3b1a5490e852f9e8233514289 P 4f3bab7efac44dea914aecf2a7422317 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:03:19.927637 18608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:19.927305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:38997)
0812 00:03:19.927529 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:19.927581 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":99,"threads_started":1}
I20260812 00:03:20.008811 18609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:20.008519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:40673)
0812 00:03:20.008690 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:20.008740 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":79,"threads_started":1}
I20260812 00:03:20.178293 18611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:20.177915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:33795)
0812 00:03:20.178178 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:20.178243 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":172,"threads_started":1}
I20260812 00:03:20.928561 18612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:20.928305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.65:33981)
0812 00:03:20.928447 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:20.928503 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":82,"threads_started":1}
I20260812 00:03:21.009673 18613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:21.009416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.66:45523)
0812 00:03:21.009571 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:21.009612 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":95,"threads_started":1}
I20260812 00:03:21.166882 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 17780
I20260812 00:03:21.179219 18614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:21.178940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42771 (local address 127.25.103.67:51287)
0812 00:03:21.179117 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:21.179163 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":75,"threads_started":1}
I20260812 00:03:21.179311 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 18061
I20260812 00:03:21.188521 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 18306
2026-08-12T00:03:21Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19022 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:03:21 dist-test-slave-vpvm krb5kdc[18619](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:03:21 dist-test-slave-vpvm krb5kdc[18619](info): set up 2 sockets
Aug 12 00:03:21 dist-test-slave-vpvm krb5kdc[18619](info): commencing operation
krb5kdc: starting...
W20260812 00:03:22.419790 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.197s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:03:22 dist-test-slave-vpvm krb5kdc[18619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:03:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:03:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:03:22.550189 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:42583
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:41041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:42583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:03:22.648809 18640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:22.649040 18640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:22.649071 18640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:22.650470 18640 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 00:03:22.650527 18640 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 00:03:22.650550 18640 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 00:03:22.650570 18640 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:03:22.650590 18640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:22.650612 18640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:22.650640 18640 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:03:22.650661 18640 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:03:22.652298 18640 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:41041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:42583
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:42583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18640
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:22.652570 18640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:22.652796 18640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:22.658089 18649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:22.658097 18657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:22.658119 18640 server_base.cc:1034] running on GCE node
W20260812 00:03:22.658098 18650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:22.658761 18640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:22.659094 18640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:22.660255 18640 hybrid_clock.cc:648] HybridClock initialized: now 1786493002660228 us; error 41 us; skew 500 ppm
Aug 12 00:03:22 dist-test-slave-vpvm krb5kdc[18619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493002, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:22.662801 18640 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:03:22.663254 18640 webserver.cc:460] Webserver started at http://127.25.103.126:45997/ using document root <none> and password file <none>
I20260812 00:03:22.663481 18640 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:22.663530 18640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:22.663663 18640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:03:22.664726 18640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "0a07c6149b624723bf8a6ab3a4e0f84d"
format_stamp: "Formatted at 2026-08-12 00:03:22 on dist-test-slave-vpvm"
server_key: "db8d8822450a155ebeb23744debad4a0"
server_key_iv: "4e696f10220c784bda478e218176d8c0"
server_key_version: "encryptionkey@0"
I20260812 00:03:22.665067 18640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "0a07c6149b624723bf8a6ab3a4e0f84d"
format_stamp: "Formatted at 2026-08-12 00:03:22 on dist-test-slave-vpvm"
server_key: "db8d8822450a155ebeb23744debad4a0"
server_key_iv: "4e696f10220c784bda478e218176d8c0"
server_key_version: "encryptionkey@0"
I20260812 00:03:22.666505 18640 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:03:22.667303 18669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:22.667589 18640 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:22.667688 18640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "0a07c6149b624723bf8a6ab3a4e0f84d"
format_stamp: "Formatted at 2026-08-12 00:03:22 on dist-test-slave-vpvm"
server_key: "db8d8822450a155ebeb23744debad4a0"
server_key_iv: "4e696f10220c784bda478e218176d8c0"
server_key_version: "encryptionkey@0"
I20260812 00:03:22.667759 18640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:22.679885 18640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:22.682163 18640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:22.682293 18640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:22.686416 18640 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:42583
I20260812 00:03:22.686452 18759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:42583 every 8 connection(s)
I20260812 00:03:22.686808 18640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:03:22.687744 18761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:22.688406 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 18640
I20260812 00:03:22.688511 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:03:22.688689 26013 external_mini_cluster.cc:1428] Setting key f1a7a2086f203f7494981d6ef490fe8a
I20260812 00:03:22.690881 18761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: Bootstrap starting.
I20260812 00:03:22.691509 18761 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:22.691761 18761 log.cc:824] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:22.692526 18761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: No bootstrap required, opened a new log
I20260812 00:03:22.694922 18761 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42583 } }
I20260812 00:03:22.695087 18761 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:22.695111 18761 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a07c6149b624723bf8a6ab3a4e0f84d, State: Initialized, Role: FOLLOWER
I20260812 00:03:22.695223 18761 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42583 } }
I20260812 00:03:22.695297 18761 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:03:22.695322 18761 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:03:22.695366 18761 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 0 FOLLOWER]: Advancing to term 1
Aug 12 00:03:22 dist-test-slave-vpvm krb5kdc[18619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:03:22.695964 18761 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42583 } }
I20260812 00:03:22.696070 18761 leader_election.cc:302] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a07c6149b624723bf8a6ab3a4e0f84d; no voters:
I20260812 00:03:22.696247 18761 leader_election.cc:288] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:03:22.696305 18767 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:03:22.696738 18761 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:03:22.696755 18767 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 1 LEADER]: Becoming Leader. State: Replica: 0a07c6149b624723bf8a6ab3a4e0f84d, State: Running, Role: LEADER
I20260812 00:03:22.696970 18767 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42583 } }
I20260812 00:03:22.697346 18768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42583 } } }
I20260812 00:03:22.697479 18768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [sys.catalog]: This master's current role is: LEADER
I20260812 00:03:22.697595 18769 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a07c6149b624723bf8a6ab3a4e0f84d. Latest consensus state: current_term: 1 leader_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42583 } } }
I20260812 00:03:22.697715 18769 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [sys.catalog]: This master's current role is: LEADER
I20260812 00:03:22.697844 18783 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:03:22.700346 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:22.689223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53850 (local address 127.25.103.126:42583)
0812 00:03:22.689382 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:22.689389 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:22.689415 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:03:22.689837 (+ 422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:22.689844 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:22.689898 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:22.690053 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:22.690871 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:22.691852 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:22.692778 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:22.693187 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:22.693269 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:22.696064 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:22.696068 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:22.696069 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:22.696081 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:22.698522 (+ 2441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:22.698905 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:22.698908 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:22.698908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:22.698998 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:22.699159 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:22.699159 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:22.699159 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:22.699399 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:22.699646 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:22.700089 (+ 443us) server_negotiation.cc:299] Negotiation successful
0812 00:03:22.700199 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":70,"threads_started":1}
I20260812 00:03:22.700917 18783 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:03:22.702916 18783 catalog_manager.cc:1347] Generated new cluster ID: d08703095ab14db498fccc77fbe3d416
I20260812 00:03:22.702965 18783 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:03:22.720361 18783 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:03:22.720904 18783 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:03:22.723203 18783 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: Generated new TSK 0
I20260812 00:03:22.723409 18783 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
I20260812 00:03:22.762085 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42583
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:41041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:03:22.848881 18807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:22.849108 18807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:22.849134 18807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:22.850329 18807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:22.850371 18807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:22.850399 18807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:03:22.851873 18807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:41041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:22.852072 18807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:22.852270 18807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:22.857183 18825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:22.857204 18815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:22.857223 18807 server_base.cc:1034] running on GCE node
W20260812 00:03:22.857299 18816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:22.857646 18807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:22.858006 18807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:22.859185 18807 hybrid_clock.cc:648] HybridClock initialized: now 1786493002859174 us; error 28 us; skew 500 ppm
Aug 12 00:03:22 dist-test-slave-vpvm krb5kdc[18619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493002, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:22.861676 18807 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:03:22.862169 18807 webserver.cc:460] Webserver started at http://127.25.103.65:44531/ using document root <none> and password file <none>
I20260812 00:03:22.862397 18807 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:22.862457 18807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:22.862581 18807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:03:22.863698 18807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "9e0349898a864ce693b02e7fa43f92b9"
format_stamp: "Formatted at 2026-08-12 00:03:22 on dist-test-slave-vpvm"
server_key: "71de6faefe88001cd917ebce16efa7d6"
server_key_iv: "3d26b9cf18d2eb7dc7079e130b498a45"
server_key_version: "encryptionkey@0"
I20260812 00:03:22.864037 18807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "9e0349898a864ce693b02e7fa43f92b9"
format_stamp: "Formatted at 2026-08-12 00:03:22 on dist-test-slave-vpvm"
server_key: "71de6faefe88001cd917ebce16efa7d6"
server_key_iv: "3d26b9cf18d2eb7dc7079e130b498a45"
server_key_version: "encryptionkey@0"
I20260812 00:03:22.865342 18807 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:03:22.866086 18834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:22.866245 18807 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:22.866331 18807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "9e0349898a864ce693b02e7fa43f92b9"
format_stamp: "Formatted at 2026-08-12 00:03:22 on dist-test-slave-vpvm"
server_key: "71de6faefe88001cd917ebce16efa7d6"
server_key_iv: "3d26b9cf18d2eb7dc7079e130b498a45"
server_key_version: "encryptionkey@0"
I20260812 00:03:22.866395 18807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:22.882648 18807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:22.884682 18807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:22.884832 18807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:22.885084 18807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:03:22.885402 18807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:03:22.885437 18807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:22.885468 18807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:03:22.885486 18807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:22.894104 18807 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:41905
I20260812 00:03:22.894170 19056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:41905 every 8 connection(s)
I20260812 00:03:22.895200 18807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:03:22.898839 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 18807
I20260812 00:03:22.898974 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:03:22.899473 26013 external_mini_cluster.cc:1428] Setting key 5bf44584d4a22a36f33dc1e43cc58dfc
Aug 12 00:03:22 dist-test-slave-vpvm krb5kdc[18619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493002, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:03:22.907107 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:22.896724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:44845 (local address 127.25.103.126:42583)
0812 00:03:22.896801 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:22.896803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:22.897166 (+ 363us) server_negotiation.cc:407] Connection header received
0812 00:03:22.898113 (+ 947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:22.898114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:22.898129 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:22.898177 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:22.900330 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:22.900932 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:22.902010 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:22.902216 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:22.902275 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:22.904499 (+ 2224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:22.904500 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:22.904500 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:22.904507 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:22.905726 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:22.906173 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:22.906174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:22.906174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:22.906228 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:22.906461 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:22.906462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:22.906462 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:22.906575 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:22.906631 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:22.906909 (+ 278us) server_negotiation.cc:299] Negotiation successful
0812 00:03:22.907011 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 00:03:22.907339 19061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:22.896820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:44845)
0812 00:03:22.896998 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:22.897044 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:22.897710 (+ 666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:22.898902 (+ 1192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:22.898907 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:22.899928 (+ 1021us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:22.900220 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:22.900228 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:22.901063 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:22.901064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:22.901900 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:22.901902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:22.902296 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:22.902297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:22.902426 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:22.902984 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:22.902993 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:22.904402 (+ 1409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:22.905800 (+ 1398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:22.905808 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:22.905810 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:22.906098 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:22.906279 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:22.906280 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:22.906280 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:22.906391 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:22.906631 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:22.906638 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:22.906781 (+ 143us) client_negotiation.cc:769] Sending connection context
0812 00:03:22.906865 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 00:03:22.907048 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":94,"threads_started":1}
I20260812 00:03:22.907783 19059 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42583
I20260812 00:03:22.907877 19059 heartbeater.cc:464] Registering TS with master...
I20260812 00:03:22.908059 19059 heartbeater.cc:511] Master 127.25.103.126:42583 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.25.103.66@KRBTEST.COM; defaulting to no policy
I20260812 00:03:22.908555 18699 ts_manager.cc:194] Registered new tserver with Master: 9e0349898a864ce693b02e7fa43f92b9 (127.25.103.65:41905)
I20260812 00:03:22.909158 18699 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:44845
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
I20260812 00:03:22.925545 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42583
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:41041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:03:23.012195 19068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:23.012404 19068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:23.012426 19068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:23.013564 19068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:23.013612 19068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:23.013638 19068 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:03:23.015132 19068 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:41041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:23.015372 19068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:23.015604 19068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:23.020484 19079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:23.020525 19076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:23.020490 19075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:23.020637 19068 server_base.cc:1034] running on GCE node
I20260812 00:03:23.020900 19068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:23.021128 19068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:23.022279 19068 hybrid_clock.cc:648] HybridClock initialized: now 1786493003022260 us; error 28 us; skew 500 ppm
Aug 12 00:03:23 dist-test-slave-vpvm krb5kdc[18619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493003, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:23.024775 19068 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:03:23.025198 19068 webserver.cc:460] Webserver started at http://127.25.103.66:36917/ using document root <none> and password file <none>
I20260812 00:03:23.025404 19068 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:23.025444 19068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:23.025547 19068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:03:23.026607 19068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "edf1bf3b223f4ed28073b7ae3776af5a"
format_stamp: "Formatted at 2026-08-12 00:03:23 on dist-test-slave-vpvm"
server_key: "56947d52de20c1896ae79e58f87be85c"
server_key_iv: "9b96647ff8838943b19f1f667386aab8"
server_key_version: "encryptionkey@0"
I20260812 00:03:23.026933 19068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "edf1bf3b223f4ed28073b7ae3776af5a"
format_stamp: "Formatted at 2026-08-12 00:03:23 on dist-test-slave-vpvm"
server_key: "56947d52de20c1896ae79e58f87be85c"
server_key_iv: "9b96647ff8838943b19f1f667386aab8"
server_key_version: "encryptionkey@0"
I20260812 00:03:23.028185 19068 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:03:23.028882 19091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:23.029054 19068 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:03:23.029145 19068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "edf1bf3b223f4ed28073b7ae3776af5a"
format_stamp: "Formatted at 2026-08-12 00:03:23 on dist-test-slave-vpvm"
server_key: "56947d52de20c1896ae79e58f87be85c"
server_key_iv: "9b96647ff8838943b19f1f667386aab8"
server_key_version: "encryptionkey@0"
I20260812 00:03:23.029204 19068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:23.047165 19068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:23.049192 19068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:23.049331 19068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:23.049548 19068 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:03:23.049885 19068 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:03:23.049921 19068 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:23.049974 19068 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:03:23.049994 19068 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:23.056586 19068 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:39655
I20260812 00:03:23.056803 19323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:39655 every 8 connection(s)
I20260812 00:03:23.057001 19068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:03:23.061630 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 19068
I20260812 00:03:23.061748 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:03:23.061939 26013 external_mini_cluster.cc:1428] Setting key 7cbe5778f40aeba340cdb472d251c276
Aug 12 00:03:23 dist-test-slave-vpvm krb5kdc[18619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493003, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:03:23.067454 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:23.057877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:34995 (local address 127.25.103.126:42583)
0812 00:03:23.057967 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:23.057969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:23.058311 (+ 342us) server_negotiation.cc:407] Connection header received
0812 00:03:23.058990 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:23.058992 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:23.059005 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:23.059047 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:23.060032 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.060564 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.061742 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.062028 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.062166 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:23.064540 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:23.064541 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:23.064542 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:23.064551 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:23.065880 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:23.066373 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:23.066374 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:23.066374 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:23.066437 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:23.066720 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:23.066721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:23.066721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:23.066840 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:23.066897 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:23.067291 (+ 394us) server_negotiation.cc:299] Negotiation successful
0812 00:03:23.067382 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:03:23.067652 19327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:23.057879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:34995)
0812 00:03:23.058122 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:23.058205 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:23.058885 (+ 680us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:23.059121 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:23.059125 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:23.059723 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:23.059924 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:23.059928 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.060709 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.060710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:23.061626 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:23.061630 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.062118 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.062119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:23.062272 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:23.062792 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:23.062803 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:23.064439 (+ 1636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:23.065984 (+ 1545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:23.065991 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:23.065994 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:23.066283 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:23.066504 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:23.066504 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:23.066505 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:23.066643 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:23.066906 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:23.066913 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:23.067108 (+ 195us) client_negotiation.cc:769] Sending connection context
0812 00:03:23.067226 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 00:03:23.067412 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":115,"threads_started":1}
I20260812 00:03:23.068137 19324 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42583
I20260812 00:03:23.068233 19324 heartbeater.cc:464] Registering TS with master...
I20260812 00:03:23.068410 19324 heartbeater.cc:511] Master 127.25.103.126:42583 requested a full tablet report, sending...
I20260812 00:03:23.068789 18699 ts_manager.cc:194] Registered new tserver with Master: edf1bf3b223f4ed28073b7ae3776af5a (127.25.103.66:39655)
I20260812 00:03:23.069167 18699 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:34995
WARNING: no policy specified for kudu/127.25.103.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
I20260812 00:03:23.090911 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42583
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:41041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:03:23.174865 19330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:23.175086 19330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:23.175117 19330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:23.176455 19330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:23.176523 19330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:23.176565 19330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:03:23.178117 19330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:41041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:42583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:23.178339 19330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:23.178558 19330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:23.183394 19337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:23.183399 19342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:23.183619 19339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:23.183621 19330 server_base.cc:1034] running on GCE node
I20260812 00:03:23.183876 19330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:23.184119 19330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:23.185269 19330 hybrid_clock.cc:648] HybridClock initialized: now 1786493003185250 us; error 35 us; skew 500 ppm
Aug 12 00:03:23 dist-test-slave-vpvm krb5kdc[18619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493003, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:23.187834 19330 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:03:23.188272 19330 webserver.cc:460] Webserver started at http://127.25.103.67:38981/ using document root <none> and password file <none>
I20260812 00:03:23.188457 19330 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:23.188496 19330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:23.188586 19330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:03:23.189601 19330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "4ddacdf86a3942c6b41059987c15f407"
format_stamp: "Formatted at 2026-08-12 00:03:23 on dist-test-slave-vpvm"
server_key: "8d7d3d641876b44e5e8d08abbc7e6712"
server_key_iv: "0d0d498922cf7ea2f7a6aae474106dfd"
server_key_version: "encryptionkey@0"
I20260812 00:03:23.189908 19330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "4ddacdf86a3942c6b41059987c15f407"
format_stamp: "Formatted at 2026-08-12 00:03:23 on dist-test-slave-vpvm"
server_key: "8d7d3d641876b44e5e8d08abbc7e6712"
server_key_iv: "0d0d498922cf7ea2f7a6aae474106dfd"
server_key_version: "encryptionkey@0"
I20260812 00:03:23.191241 19330 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:23.192083 19355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:23.192293 19330 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:23.192399 19330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "4ddacdf86a3942c6b41059987c15f407"
format_stamp: "Formatted at 2026-08-12 00:03:23 on dist-test-slave-vpvm"
server_key: "8d7d3d641876b44e5e8d08abbc7e6712"
server_key_iv: "0d0d498922cf7ea2f7a6aae474106dfd"
server_key_version: "encryptionkey@0"
I20260812 00:03:23.192471 19330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:23.204486 19330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:23.206676 19330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:23.206796 19330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:23.206997 19330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:03:23.207261 19330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:03:23.207291 19330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:23.207312 19330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:03:23.207329 19330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:23.214206 19330 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:42591
I20260812 00:03:23.214260 19529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:42591 every 8 connection(s)
I20260812 00:03:23.214696 19330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:03:23.216598 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 19330
I20260812 00:03:23.216691 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:03:23.216837 26013 external_mini_cluster.cc:1428] Setting key a757174e325c9e6474a7228196544d38
Aug 12 00:03:23 dist-test-slave-vpvm krb5kdc[18619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493003, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:03:23.223902 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:23.215650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:54937 (local address 127.25.103.126:42583)
0812 00:03:23.215702 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:23.215704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:23.215894 (+ 190us) server_negotiation.cc:407] Connection header received
0812 00:03:23.216405 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:23.216406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:23.216420 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:23.216472 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:23.217567 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.218120 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.219100 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.219297 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.219356 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:23.221399 (+ 2043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:23.221401 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:23.221401 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:23.221409 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:23.222568 (+ 1159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:23.222938 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:23.222939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:23.222939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:23.222999 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:23.223248 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:23.223249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:23.223249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:23.223373 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:23.223432 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:23.223725 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 00:03:23.223812 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:03:23.224071 19536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:23.215606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:54937)
0812 00:03:23.215775 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:23.215811 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:23.216309 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:23.216551 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:23.216555 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:23.217275 (+ 720us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:23.217475 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:23.217480 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.218199 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.218200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:23.219012 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:23.219014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.219371 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.219372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:23.219489 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:23.219943 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:23.219950 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:23.221312 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:23.222643 (+ 1331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:23.222650 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:23.222652 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:23.222871 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:23.223055 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:23.223055 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:23.223056 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:23.223182 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:23.223430 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:23.223438 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:23.223573 (+ 135us) client_negotiation.cc:769] Sending connection context
0812 00:03:23.223688 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 00:03:23.223854 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":89,"threads_started":1}
I20260812 00:03:23.224598 19532 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42583
I20260812 00:03:23.224685 19532 heartbeater.cc:464] Registering TS with master...
I20260812 00:03:23.224830 19532 heartbeater.cc:511] Master 127.25.103.126:42583 requested a full tablet report, sending...
I20260812 00:03:23.225180 18699 ts_manager.cc:194] Registered new tserver with Master: 4ddacdf86a3942c6b41059987c15f407 (127.25.103.67:42591)
I20260812 00:03:23.225600 18699 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:54937
I20260812 00:03:23.228288 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:03:23.235203 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:23.229545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53862 (local address 127.25.103.126:42583)
0812 00:03:23.229587 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:23.229589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:23.229713 (+ 124us) server_negotiation.cc:407] Connection header received
0812 00:03:23.229775 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:23.229776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:23.229786 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:23.229830 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:23.230408 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.230969 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.231696 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.231887 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.231964 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:23.233091 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:23.233093 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:23.233093 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:23.233100 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:23.234181 (+ 1081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:23.234470 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:23.234471 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:23.234471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:23.234528 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:23.234688 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:23.234688 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:23.234689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:23.234829 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:23.234919 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:23.235027 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 00:03:23.235110 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:03:23.237543 18699 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53862:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:03:23.239367 18699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:03:23.246033 19561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:23.241755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:42591 (local address 127.0.0.1:49478)
0812 00:03:23.242343 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:23.242352 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:23.242406 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:23.242634 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:23.242635 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:23.242637 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:23.242693 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:23.242695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.243593 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.243594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:23.244763 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:23.244766 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.245738 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.245739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:23.245801 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:23.245805 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:03:23.245850 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 00:03:23.245916 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"mutex_wait_us":461,"thread_start_us":72,"threads_started":1}
I20260812 00:03:23.246059 19556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:23.242066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42058 (local address 127.25.103.66:39655)
0812 00:03:23.242223 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:23.242228 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:23.242362 (+ 134us) server_negotiation.cc:407] Connection header received
0812 00:03:23.242491 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:23.242494 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:23.242508 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:23.242560 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:23.242796 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.243916 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.245060 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.245531 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.245603 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:23.245735 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:23.245899 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 00:03:23.245943 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":90,"threads_started":1}
I20260812 00:03:23.246141 19555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:23.241883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41432 (local address 127.25.103.65:41905)
0812 00:03:23.242389 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:23.242394 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:23.242404 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:03:23.242445 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:23.242447 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:23.242463 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:23.242732 (+ 269us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:23.242796 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.243916 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.245120 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.245779 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.245839 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:23.245890 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:23.246022 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 00:03:23.246067 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":116,"threads_started":1}
I20260812 00:03:23.246393 19557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:23.242100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49478 (local address 127.25.103.67:42591)
0812 00:03:23.242288 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:23.242292 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:23.242396 (+ 104us) server_negotiation.cc:407] Connection header received
0812 00:03:23.242468 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:23.242470 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:23.242486 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:23.242554 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:23.242766 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.243494 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.244847 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.245574 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.245643 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:23.245702 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:23.246289 (+ 587us) server_negotiation.cc:299] Negotiation successful
0812 00:03:23.246332 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":100,"threads_started":1}
I20260812 00:03:23.246136 19554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:23.241751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:41905 (local address 127.0.0.1:41432)
0812 00:03:23.241928 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:23.241994 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:23.242062 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:23.242584 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:23.242587 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:23.242589 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:23.242659 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:23.242661 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.244024 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.244025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:23.245052 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:23.245055 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.245855 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.245856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:23.245913 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:23.245917 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:03:23.246007 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 00:03:23.246048 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":30,"thread_start_us":68,"threads_started":1}
I20260812 00:03:23.246264 19553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:23.241751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:39655 (local address 127.0.0.1:42058)
0812 00:03:23.242286 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:23.242298 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:23.242369 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:23.242666 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:23.242667 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:23.242669 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:23.242716 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:23.242717 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.244043 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.244044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:23.244968 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:23.244970 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.245617 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.245618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:23.245760 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:23.245779 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 00:03:23.246172 (+ 393us) client_negotiation.cc:240] Negotiation successful
0812 00:03:23.246212 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"mutex_wait_us":30,"thread_start_us":105,"threads_started":1}
I20260812 00:03:23.247298 19198 tablet_service.cc:1467] Processing CreateTablet for tablet e68a8c86ebfe4686b7116a890b498f44 (DEFAULT_TABLE table=test-table [id=5abca9b42b8e485d9840885036f767fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:03:23.247277 18920 tablet_service.cc:1467] Processing CreateTablet for tablet e68a8c86ebfe4686b7116a890b498f44 (DEFAULT_TABLE table=test-table [id=5abca9b42b8e485d9840885036f767fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:03:23.247609 18920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e68a8c86ebfe4686b7116a890b498f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:23.247622 19198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e68a8c86ebfe4686b7116a890b498f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:23.250274 19562 tablet_bootstrap.cc:492] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9: Bootstrap starting.
I20260812 00:03:23.250636 19429 tablet_service.cc:1467] Processing CreateTablet for tablet e68a8c86ebfe4686b7116a890b498f44 (DEFAULT_TABLE table=test-table [id=5abca9b42b8e485d9840885036f767fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:03:23.250877 19562 tablet_bootstrap.cc:654] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:23.250921 19429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e68a8c86ebfe4686b7116a890b498f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:23.251296 19562 log.cc:824] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:23.251593 19567 tablet_bootstrap.cc:492] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: Bootstrap starting.
I20260812 00:03:23.252022 19562 tablet_bootstrap.cc:492] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9: No bootstrap required, opened a new log
I20260812 00:03:23.252092 19562 ts_tablet_manager.cc:1397] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:03:23.252331 19567 tablet_bootstrap.cc:654] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:23.252934 19567 log.cc:824] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:23.253867 19567 tablet_bootstrap.cc:492] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: No bootstrap required, opened a new log
I20260812 00:03:23.254016 19567 ts_tablet_manager.cc:1397] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:03:23.254156 19562 raft_consensus.cc:348] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } }
I20260812 00:03:23.254343 19562 raft_consensus.cc:374] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:23.254390 19562 raft_consensus.cc:729] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0349898a864ce693b02e7fa43f92b9, State: Initialized, Role: FOLLOWER
I20260812 00:03:23.254509 19562 consensus_queue.cc:260] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } }
I20260812 00:03:23.254666 19572 tablet_bootstrap.cc:492] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407: Bootstrap starting.
I20260812 00:03:23.254820 19562 ts_tablet_manager.cc:1428] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:03:23.254957 19059 heartbeater.cc:503] Master 127.25.103.126:42583 was elected leader, sending a full tablet report...
I20260812 00:03:23.255648 19572 tablet_bootstrap.cc:654] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:23.256189 19572 log.cc:824] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:23.256569 19567 raft_consensus.cc:348] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } }
I20260812 00:03:23.256733 19567 raft_consensus.cc:374] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:23.256778 19567 raft_consensus.cc:729] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf1bf3b223f4ed28073b7ae3776af5a, State: Initialized, Role: FOLLOWER
I20260812 00:03:23.256893 19567 consensus_queue.cc:260] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } }
I20260812 00:03:23.256961 19572 tablet_bootstrap.cc:492] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407: No bootstrap required, opened a new log
I20260812 00:03:23.257030 19572 ts_tablet_manager.cc:1397] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:03:23.257194 19567 ts_tablet_manager.cc:1428] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:03:23.257220 19324 heartbeater.cc:503] Master 127.25.103.126:42583 was elected leader, sending a full tablet report...
I20260812 00:03:23.259219 19572 raft_consensus.cc:348] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } }
I20260812 00:03:23.259367 19572 raft_consensus.cc:374] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:23.259390 19572 raft_consensus.cc:729] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ddacdf86a3942c6b41059987c15f407, State: Initialized, Role: FOLLOWER
I20260812 00:03:23.259485 19572 consensus_queue.cc:260] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } }
I20260812 00:03:23.259721 19572 ts_tablet_manager.cc:1428] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:03:23.259770 19532 heartbeater.cc:503] Master 127.25.103.126:42583 was elected leader, sending a full tablet report...
W20260812 00:03:23.307938 19326 tablet.cc:2369] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:03:23.397477 19060 tablet.cc:2369] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:03:23.465320 19535 tablet.cc:2369] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:03:23.516983 19576 raft_consensus.cc:482] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:03:23.517131 19576 raft_consensus.cc:504] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } }
I20260812 00:03:23.517647 19576 leader_election.cc:288] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ddacdf86a3942c6b41059987c15f407 (127.25.103.67:42591), 9e0349898a864ce693b02e7fa43f92b9 (127.25.103.65:41905)
I20260812 00:03:23.521719 19555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:23.518071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:34899 (local address 127.25.103.65:41905)
0812 00:03:23.518128 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:23.518130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:23.518280 (+ 150us) server_negotiation.cc:407] Connection header received
0812 00:03:23.518307 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:23.518308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:23.518316 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:23.518366 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:23.518491 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.519224 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.520731 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.521302 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.521382 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:23.521392 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:23.521603 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 00:03:23.521643 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:03:23.521719 19557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:23.518021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:39179 (local address 127.25.103.67:42591)
0812 00:03:23.518087 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:23.518089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:23.518098 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:03:23.518132 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:23.518133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:23.518142 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:23.518202 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:23.518368 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.519223 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.520731 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.521303 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.521383 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:23.521392 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:23.521603 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 00:03:23.521643 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 00:03:23.521755 19327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:23.517841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:42591 (local address 127.25.103.66:39179)
0812 00:03:23.517895 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:23.517908 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:23.517978 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:23.518216 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:23.518217 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:23.518220 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:23.518299 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:23.518301 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.519320 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.519321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:23.520625 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:23.520629 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.521428 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.521429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:23.521523 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:23.521525 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:03:23.521592 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 00:03:23.521646 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":75}
I20260812 00:03:23.521761 19582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:23.517983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:41905 (local address 127.25.103.66:34899)
0812 00:03:23.518199 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:23.518208 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:23.518265 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:23.518382 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:23.518382 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:23.518384 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:23.518434 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:23.518435 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.519320 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.519321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:23.520625 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:23.520629 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.521428 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.521429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:23.521520 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:23.521525 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:03:23.521592 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 00:03:23.521646 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":64,"thread_start_us":143,"threads_started":1}
I20260812 00:03:23.522210 18959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e68a8c86ebfe4686b7116a890b498f44" candidate_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0349898a864ce693b02e7fa43f92b9" is_pre_election: true
I20260812 00:03:23.522190 19458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e68a8c86ebfe4686b7116a890b498f44" candidate_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ddacdf86a3942c6b41059987c15f407" is_pre_election: true
I20260812 00:03:23.522372 19458 raft_consensus.cc:2454] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edf1bf3b223f4ed28073b7ae3776af5a in term 0.
I20260812 00:03:23.522372 18959 raft_consensus.cc:2454] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edf1bf3b223f4ed28073b7ae3776af5a in term 0.
I20260812 00:03:23.522609 19096 leader_election.cc:302] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0349898a864ce693b02e7fa43f92b9, edf1bf3b223f4ed28073b7ae3776af5a; no voters:
I20260812 00:03:23.522754 19576 raft_consensus.cc:2781] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:03:23.522816 19576 raft_consensus.cc:482] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:03:23.522840 19576 raft_consensus.cc:3037] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:03:23.523630 19576 raft_consensus.cc:504] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } }
I20260812 00:03:23.523761 19576 leader_election.cc:288] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [CANDIDATE]: Term 1 election: Requested vote from peers 4ddacdf86a3942c6b41059987c15f407 (127.25.103.67:42591), 9e0349898a864ce693b02e7fa43f92b9 (127.25.103.65:41905)
I20260812 00:03:23.523995 19458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e68a8c86ebfe4686b7116a890b498f44" candidate_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ddacdf86a3942c6b41059987c15f407"
I20260812 00:03:23.523983 18959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e68a8c86ebfe4686b7116a890b498f44" candidate_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0349898a864ce693b02e7fa43f92b9"
I20260812 00:03:23.524083 18959 raft_consensus.cc:3037] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:03:23.524083 19458 raft_consensus.cc:3037] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:03:23.524974 19458 raft_consensus.cc:2454] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf1bf3b223f4ed28073b7ae3776af5a in term 1.
I20260812 00:03:23.524974 18959 raft_consensus.cc:2454] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf1bf3b223f4ed28073b7ae3776af5a in term 1.
I20260812 00:03:23.525148 19093 leader_election.cc:302] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ddacdf86a3942c6b41059987c15f407, edf1bf3b223f4ed28073b7ae3776af5a; no voters:
I20260812 00:03:23.525261 19576 raft_consensus.cc:2781] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:03:23.525413 19576 raft_consensus.cc:686] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [term 1 LEADER]: Becoming Leader. State: Replica: edf1bf3b223f4ed28073b7ae3776af5a, State: Running, Role: LEADER
I20260812 00:03:23.525509 19576 consensus_queue.cc:237] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } }
I20260812 00:03:23.526353 18699 catalog_manager.cc:5495] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a reported cstate change: term changed from 0 to 1, leader changed from <none> to edf1bf3b223f4ed28073b7ae3776af5a (127.25.103.66). New cstate: current_term: 1 leader_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } health_report { overall_health: UNKNOWN } } }
I20260812 00:03:23.598990 19556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:23.596714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42068 (local address 127.25.103.66:39655)
0812 00:03:23.596786 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:23.596788 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:23.596799 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:03:23.596839 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:23.596841 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:23.596860 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:23.596949 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:03:23.597052 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.597535 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.598330 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:23.598529 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:23.598578 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:23.598686 (+ 108us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:03:23.598791 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:03:23.598848 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:23.598863 (+ 15us) server_negotiation.cc:299] Negotiation successful
0812 00:03:23.598881 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 00:03:23.601012 18959 raft_consensus.cc:1261] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Refusing update from remote peer edf1bf3b223f4ed28073b7ae3776af5a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:03:23.601037 19458 raft_consensus.cc:1261] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407 [term 1 FOLLOWER]: Refusing update from remote peer edf1bf3b223f4ed28073b7ae3776af5a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:03:23.601372 19584 consensus_queue.cc:1035] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:03:23.601507 19576 consensus_queue.cc:1035] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:03:23.603839 19589 mvcc.cc:205] Tried to move back new op lower bound from 7317475342746583040 to 7317475342441025536. Current Snapshot: MvccSnapshot[applied={T|T < 7317475342746583040}]
I20260812 00:03:23.604496 19592 mvcc.cc:205] Tried to move back new op lower bound from 7317475342746583040 to 7317475342441025536. Current Snapshot: MvccSnapshot[applied={T|T < 7317475342746583040}]
I20260812 00:03:23.604600 19595 mvcc.cc:205] Tried to move back new op lower bound from 7317475342746583040 to 7317475342441025536. Current Snapshot: MvccSnapshot[applied={T|T < 7317475342746583040}]
I20260812 00:03:23.607007 18695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53862:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:03:23.607126 18695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53862:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:03:23.608148 18695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: Sending DeleteTablet for 3 replicas of tablet e68a8c86ebfe4686b7116a890b498f44
I20260812 00:03:23.608703 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 18807
I20260812 00:03:23.608700 19198 tablet_service.cc:1514] Processing DeleteTablet for tablet e68a8c86ebfe4686b7116a890b498f44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:03:23 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:42058
I20260812 00:03:23.609274 19429 tablet_service.cc:1514] Processing DeleteTablet for tablet e68a8c86ebfe4686b7116a890b498f44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:03:23 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:49478
I20260812 00:03:23.620467 19610 tablet_replica.cc:330] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407: stopping tablet replica
I20260812 00:03:23.620769 19610 raft_consensus.cc:2229] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:03:23.621042 19610 raft_consensus.cc:2258] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:03:23.621824 19610 ts_tablet_manager.cc:1905] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:03:23.623703 19610 ts_tablet_manager.cc:1918] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:03:23.623874 19610 log.cc:1196] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/e68a8c86ebfe4686b7116a890b498f44
I20260812 00:03:23.624300 19610 ts_tablet_manager.cc:1939] T e68a8c86ebfe4686b7116a890b498f44 P 4ddacdf86a3942c6b41059987c15f407: Deleting consensus metadata
I20260812 00:03:23.624954 18670 catalog_manager.cc:4841] TS 4ddacdf86a3942c6b41059987c15f407 (127.25.103.67:42591): tablet e68a8c86ebfe4686b7116a890b498f44 (table test-table [id=5abca9b42b8e485d9840885036f767fa]) successfully deleted
I20260812 00:03:23.628371 19609 tablet_replica.cc:330] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: stopping tablet replica
I20260812 00:03:23.628535 19609 raft_consensus.cc:2229] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:03:23.628698 19609 raft_consensus.cc:2258] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 00:03:23.628932 18673 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.103.65:41905 (error 108)
I20260812 00:03:23.629390 19609 ts_tablet_manager.cc:1905] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:03:23.629446 19553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:23.629322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:41905 (local address 127.0.0.1:41442)
0812 00:03:23.629374 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:23.629410 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:41905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 00:03:23.629551 18673 catalog_manager.cc:4584] TS 9e0349898a864ce693b02e7fa43f92b9 (127.25.103.65:41905): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e68a8c86ebfe4686b7116a890b498f44: Network error: Client connection negotiation failed: client connection to 127.25.103.65:41905: connect: Connection refused (error 111)
I20260812 00:03:23.629881 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 19068
I20260812 00:03:23.642103 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 19330
I20260812 00:03:23.642123 19553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:23.641975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:39655 (local address 127.0.0.1:42070)
0812 00:03:23.642045 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:23.642075 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.66:39655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 00:03:23.665127 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 18640
I20260812 00:03:43.679718 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:42583
--webserver_interface=127.25.103.126
--webserver_port=45997
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:41041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:42583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:03:43.763365 19614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:43.763607 19614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:43.763629 19614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:43.764854 19614 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 00:03:43.764901 19614 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 00:03:43.764914 19614 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 00:03:43.764923 19614 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:03:43.764935 19614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:43.764946 19614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:43.764957 19614 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:03:43.764969 19614 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:03:43.767062 19614 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:41041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:42583
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:42583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=45997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:43.767582 19614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:43.767882 19614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:43.777420 19630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:43.777386 19634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:43.777401 19631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:43.777743 19614 server_base.cc:1034] running on GCE node
I20260812 00:03:43.778086 19614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:43.778450 19614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:43.779620 19614 hybrid_clock.cc:648] HybridClock initialized: now 1786493023779592 us; error 31 us; skew 500 ppm
Aug 12 00:03:43 dist-test-slave-vpvm krb5kdc[18619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493023, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:43.784768 19614 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:03:43.785254 19614 webserver.cc:460] Webserver started at http://127.25.103.126:45997/ using document root <none> and password file <none>
I20260812 00:03:43.785486 19614 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:43.785554 19614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:43.787000 19614 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:43.787714 19643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:43.787906 19614 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:43.788005 19614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "0a07c6149b624723bf8a6ab3a4e0f84d"
format_stamp: "Formatted at 2026-08-12 00:03:22 on dist-test-slave-vpvm"
server_key: "db8d8822450a155ebeb23744debad4a0"
server_key_iv: "4e696f10220c784bda478e218176d8c0"
server_key_version: "encryptionkey@0"
I20260812 00:03:43.788414 19614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:43.812784 19614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:43.815078 19614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:43.815225 19614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:43.819351 19614 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:42583
I20260812 00:03:43.819411 19740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:42583 every 8 connection(s)
I20260812 00:03:43.819792 19614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:03:43.821327 19742 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:03:43.822134 19742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: Bootstrap starting.
I20260812 00:03:43.826323 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 19614
I20260812 00:03:43.826671 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:41905
--local_ip_for_outbound_sockets=127.25.103.65
--tserver_master_addrs=127.25.103.126:42583
--webserver_port=44531
--webserver_interface=127.25.103.65
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:41041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:03:43.832084 19742 log.cc:824] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:43.834249 19742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:03:43.834568 19742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: Bootstrap complete.
I20260812 00:03:43.836824 19742 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42583 } }
I20260812 00:03:43.837055 19742 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a07c6149b624723bf8a6ab3a4e0f84d, State: Initialized, Role: FOLLOWER
I20260812 00:03:43.837199 19742 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42583 } }
I20260812 00:03:43.837262 19742 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:03:43.837307 19742 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:03:43.837353 19742 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:03:43.838428 19742 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42583 } }
I20260812 00:03:43.838531 19742 leader_election.cc:302] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a07c6149b624723bf8a6ab3a4e0f84d; no voters:
I20260812 00:03:43.838701 19742 leader_election.cc:288] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:03:43.838748 19747 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:03:43.838925 19747 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 2 LEADER]: Becoming Leader. State: Replica: 0a07c6149b624723bf8a6ab3a4e0f84d, State: Running, Role: LEADER
I20260812 00:03:43.838977 19742 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:03:43.839845 19747 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42583 } }
I20260812 00:03:43.840421 19750 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a07c6149b624723bf8a6ab3a4e0f84d. Latest consensus state: current_term: 2 leader_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42583 } } }
I20260812 00:03:43.840490 19751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42583 } } }
I20260812 00:03:43.840524 19750 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [sys.catalog]: This master's current role is: LEADER
I20260812 00:03:43.840541 19751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [sys.catalog]: This master's current role is: LEADER
I20260812 00:03:43.840977 19774 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:03:43.841769 19774 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:03:43.841893 19774 catalog_manager.cc:1259] Loaded cluster ID: d08703095ab14db498fccc77fbe3d416
I20260812 00:03:43.841933 19774 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:03:43.843080 19774 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:03:43.843290 19774 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: Loaded TSK: 0
I20260812 00:03:43.852818 19774 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: Generated new TSK 1
I20260812 00:03:43.852947 19774 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:03:43.917820 19745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:43.918099 19745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:43.918139 19745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:43.919350 19745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:43.919397 19745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:43.919435 19745 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:03:43.920976 19745 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:41041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:41905
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=44531
--tserver_master_addrs=127.25.103.126:42583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:43.921224 19745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:43.921458 19745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:43.927582 19799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:43.927731 19745 server_base.cc:1034] running on GCE node
W20260812 00:03:43.927760 19798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:43.927619 19802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:43.928042 19745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:43.928308 19745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:43.929462 19745 hybrid_clock.cc:648] HybridClock initialized: now 1786493023929443 us; error 34 us; skew 500 ppm
Aug 12 00:03:43 dist-test-slave-vpvm krb5kdc[18619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493023, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:43.932276 19745 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:03:43.932778 19745 webserver.cc:460] Webserver started at http://127.25.103.65:44531/ using document root <none> and password file <none>
I20260812 00:03:43.933013 19745 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:43.933090 19745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:43.934504 19745 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:03:43.935129 19815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:43.935339 19745 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:43.935447 19745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "9e0349898a864ce693b02e7fa43f92b9"
format_stamp: "Formatted at 2026-08-12 00:03:22 on dist-test-slave-vpvm"
server_key: "71de6faefe88001cd917ebce16efa7d6"
server_key_iv: "3d26b9cf18d2eb7dc7079e130b498a45"
server_key_version: "encryptionkey@0"
I20260812 00:03:43.935935 19745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:43.960991 19745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:43.963807 19745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:43.963985 19745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:43.964279 19745 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:03:43.964854 19829 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 00:03:43.966586 19745 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 00:03:43.966655 19745 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 00:03:43.966691 19745 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 00:03:43.967593 19745 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 00:03:43.967645 19745 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 00:03:43.967723 19829 tablet_bootstrap.cc:492] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9: Bootstrap starting.
I20260812 00:03:43.974646 19745 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:41905
I20260812 00:03:43.974933 20002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:41905 every 8 connection(s)
I20260812 00:03:43.975103 19745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:03:43.978403 19829 log.cc:824] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:43.981750 19829 tablet_bootstrap.cc:492] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:03:43.982128 19829 tablet_bootstrap.cc:492] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9: Bootstrap complete.
I20260812 00:03:43.983027 19829 ts_tablet_manager.cc:1397] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.006s
Aug 12 00:03:43 dist-test-slave-vpvm krb5kdc[18619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493023, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:03:43.983857 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 19745
I20260812 00:03:43.984122 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:39655
--local_ip_for_outbound_sockets=127.25.103.66
--tserver_master_addrs=127.25.103.126:42583
--webserver_port=36917
--webserver_interface=127.25.103.66
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:41041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:03:43.984241 19829 raft_consensus.cc:348] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } }
I20260812 00:03:43.984534 19829 raft_consensus.cc:729] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0349898a864ce693b02e7fa43f92b9, State: Initialized, Role: FOLLOWER
I20260812 00:03:43.984680 19829 consensus_queue.cc:260] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } }
I20260812 00:03:43.984987 19829 ts_tablet_manager.cc:1428] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260812 00:03:43.987974 20006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:43.975928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:48727 (local address 127.25.103.126:42583)
0812 00:03:43.976202 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:43.976212 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:43.976257 (+ 45us) server_negotiation.cc:407] Connection header received
0812 00:03:43.977144 (+ 887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:43.977152 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:43.977216 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:43.977388 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:43.978231 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:43.979294 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:43.980786 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:43.981424 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:43.981555 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:43.984313 (+ 2758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:43.984317 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:43.984317 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:43.984328 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:43.986173 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:43.986630 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:43.986633 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:43.986634 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:43.986768 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:43.987019 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:43.987020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:43.987020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:43.987328 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:43.987416 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:43.987720 (+ 304us) server_negotiation.cc:299] Negotiation successful
0812 00:03:43.987838 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":82,"threads_started":1}
I20260812 00:03:43.988006 20005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:43.975866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:48727)
0812 00:03:43.976088 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:43.976137 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:43.976860 (+ 723us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:43.977410 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:43.977420 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:43.977799 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:43.978095 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:43.978103 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:43.979428 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:43.979429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:43.980671 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:43.980675 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:43.981552 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:43.981553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:43.981710 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:43.982365 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:43.982377 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:43.984188 (+ 1811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:43.986261 (+ 2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:43.986268 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:43.986270 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:43.986541 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:43.986841 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:43.986841 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:43.986842 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:43.986959 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:43.987400 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:43.987404 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:43.987553 (+ 149us) client_negotiation.cc:769] Sending connection context
0812 00:03:43.987648 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 00:03:43.987810 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":124,"threads_started":1}
I20260812 00:03:43.988835 20003 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42583
I20260812 00:03:43.988934 20003 heartbeater.cc:464] Registering TS with master...
I20260812 00:03:43.989112 20003 heartbeater.cc:511] Master 127.25.103.126:42583 requested a full tablet report, sending...
I20260812 00:03:43.989912 19678 ts_manager.cc:194] Registered new tserver with Master: 9e0349898a864ce693b02e7fa43f92b9 (127.25.103.65:41905)
I20260812 00:03:43.991039 19678 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:48727
I20260812 00:03:43.992065 20003 heartbeater.cc:503] Master 127.25.103.126:42583 was elected leader, sending a full tablet report...
I20260812 00:03:43.996251 20011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:43.990596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:41905 (local address 127.0.0.1:40464)
0812 00:03:43.991222 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:43.991264 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:43.992288 (+ 1024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:43.992660 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:43.992664 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:43.992667 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:43.992740 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:43.992742 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:43.993538 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:43.993539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:43.994853 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:43.994857 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:43.995777 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:43.995779 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:43.995881 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:43.995898 (+ 17us) client_negotiation.cc:769] Sending connection context
0812 00:03:43.996075 (+ 177us) client_negotiation.cc:240] Negotiation successful
0812 00:03:43.996160 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":90,"threads_started":1}
I20260812 00:03:43.997110 20012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:43.990869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40464 (local address 127.25.103.65:41905)
0812 00:03:43.991039 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:43.991043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:43.991419 (+ 376us) server_negotiation.cc:407] Connection header received
0812 00:03:43.992430 (+ 1011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:43.992432 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:43.992449 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:43.992519 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:43.992817 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:43.993457 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:43.994948 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:43.995656 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:43.995733 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:43.995785 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:43.996977 (+ 1192us) server_negotiation.cc:299] Negotiation successful
0812 00:03:43.997040 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":76,"threads_started":1}
I20260812 00:03:43.997571 19896 tablet_service.cc:1514] Processing DeleteTablet for tablet e68a8c86ebfe4686b7116a890b498f44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:03:23 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:40464
I20260812 00:03:43.998185 20013 tablet_replica.cc:330] stopping tablet replica
I20260812 00:03:43.998296 20013 raft_consensus.cc:2229] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:03:43.998375 20013 raft_consensus.cc:2258] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:03:43.998721 20013 ts_tablet_manager.cc:1905] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:03:44.001097 20013 ts_tablet_manager.cc:1918] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:03:44.001170 20013 log.cc:1196] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/wal/wals/e68a8c86ebfe4686b7116a890b498f44
I20260812 00:03:44.001390 20013 ts_tablet_manager.cc:1939] T e68a8c86ebfe4686b7116a890b498f44 P 9e0349898a864ce693b02e7fa43f92b9: Deleting consensus metadata
I20260812 00:03:44.002054 19650 catalog_manager.cc:4841] TS 9e0349898a864ce693b02e7fa43f92b9 (127.25.103.65:41905): tablet e68a8c86ebfe4686b7116a890b498f44 (table test-table [id=5abca9b42b8e485d9840885036f767fa]) successfully deleted
W20260812 00:03:44.073213 20010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:44.073429 20010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:44.073462 20010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:44.074651 20010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:44.074692 20010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:44.074728 20010 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:03:44.076161 20010 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:41041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:39655
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=36917
--tserver_master_addrs=127.25.103.126:42583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:44.076391 20010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:44.076604 20010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:44.081593 20023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:44.081610 20026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:44.081600 20024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:44.081693 20010 server_base.cc:1034] running on GCE node
I20260812 00:03:44.082042 20010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:44.082293 20010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:44.083462 20010 hybrid_clock.cc:648] HybridClock initialized: now 1786493024083441 us; error 32 us; skew 500 ppm
Aug 12 00:03:44 dist-test-slave-vpvm krb5kdc[18619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493024, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:44.086086 20010 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:03:44.086509 20010 webserver.cc:460] Webserver started at http://127.25.103.66:36917/ using document root <none> and password file <none>
I20260812 00:03:44.086689 20010 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:44.086743 20010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:44.088115 20010 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:44.088837 20035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:44.089002 20010 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:44.089090 20010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "edf1bf3b223f4ed28073b7ae3776af5a"
format_stamp: "Formatted at 2026-08-12 00:03:23 on dist-test-slave-vpvm"
server_key: "56947d52de20c1896ae79e58f87be85c"
server_key_iv: "9b96647ff8838943b19f1f667386aab8"
server_key_version: "encryptionkey@0"
I20260812 00:03:44.089452 20010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:44.105881 20010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:44.108214 20010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:44.108345 20010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:44.108556 20010 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:03:44.109059 20045 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 00:03:44.110702 20010 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 00:03:44.110769 20010 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 00:03:44.110808 20010 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 00:03:44.111689 20010 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 00:03:44.111737 20010 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 00:03:44.111817 20045 tablet_bootstrap.cc:492] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: Bootstrap starting.
I20260812 00:03:44.113511 20045 log.cc:824] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:44.116662 20045 tablet_bootstrap.cc:492] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:03:44.116997 20045 tablet_bootstrap.cc:492] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: Bootstrap complete.
I20260812 00:03:44.117161 20045 ts_tablet_manager.cc:1397] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260812 00:03:44.118427 20010 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:39655
I20260812 00:03:44.118479 20239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:39655 every 8 connection(s)
I20260812 00:03:44.118809 20010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:03:44.119002 20045 raft_consensus.cc:348] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } }
I20260812 00:03:44.119328 20045 raft_consensus.cc:729] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf1bf3b223f4ed28073b7ae3776af5a, State: Initialized, Role: FOLLOWER
I20260812 00:03:44.119475 20045 consensus_queue.cc:260] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } }
I20260812 00:03:44.119845 20045 ts_tablet_manager.cc:1428] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: Time spent starting tablet: real 0.003s user 0.006s sys 0.000s
I20260812 00:03:44.122475 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 20010
I20260812 00:03:44.122764 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:42591
--local_ip_for_outbound_sockets=127.25.103.67
--tserver_master_addrs=127.25.103.126:42583
--webserver_port=38981
--webserver_interface=127.25.103.67
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:41041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:03:44 dist-test-slave-vpvm krb5kdc[18619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493024, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:03:44.129490 20006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:44.119581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:42381 (local address 127.25.103.126:42583)
0812 00:03:44.119641 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:44.119643 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:44.119959 (+ 316us) server_negotiation.cc:407] Connection header received
0812 00:03:44.120136 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:44.120137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:44.120147 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:44.120198 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:44.120877 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.121395 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.122533 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.122836 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.122912 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:44.126377 (+ 3465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:44.126380 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:44.126380 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:44.126388 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:44.127861 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:44.128295 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:44.128297 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:44.128297 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:44.128371 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:44.128670 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:44.128671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:44.128672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:44.128847 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:44.128936 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:44.129249 (+ 313us) server_negotiation.cc:299] Negotiation successful
0812 00:03:44.129362 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:03:44.129796 20246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:44.119562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:42381)
0812 00:03:44.119828 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:44.119870 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:44.120045 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:44.120241 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:44.120244 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:44.120513 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:44.120708 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:44.120712 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.121514 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.121515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:44.122444 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:44.122447 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.122992 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.122993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:44.123265 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:44.123887 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:44.123898 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:44.126268 (+ 2370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:44.127967 (+ 1699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:44.127976 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:44.127979 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:44.128215 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:44.128454 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:44.128455 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:44.128455 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:44.128593 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:44.128947 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:44.128955 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:44.129104 (+ 149us) client_negotiation.cc:769] Sending connection context
0812 00:03:44.129206 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 00:03:44.129352 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":186,"threads_started":1}
I20260812 00:03:44.130319 20242 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42583
I20260812 00:03:44.130450 20242 heartbeater.cc:464] Registering TS with master...
I20260812 00:03:44.130659 20242 heartbeater.cc:511] Master 127.25.103.126:42583 requested a full tablet report, sending...
I20260812 00:03:44.131421 19678 ts_manager.cc:194] Registered new tserver with Master: edf1bf3b223f4ed28073b7ae3776af5a (127.25.103.66:39655)
I20260812 00:03:44.132019 19678 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:42381
I20260812 00:03:44.132901 20242 heartbeater.cc:503] Master 127.25.103.126:42583 was elected leader, sending a full tablet report...
Aug 12 00:03:44 dist-test-slave-vpvm krb5kdc[18619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493023, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for kudu/127.25.103.66@KRBTEST.COM
I20260812 00:03:44.140937 20249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:44.131848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53310 (local address 127.25.103.66:39655)
0812 00:03:44.132029 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:44.132034 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:44.132044 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:03:44.132081 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:44.132084 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:44.132097 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:44.132252 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:44.132807 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.134042 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.134870 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.135364 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.135469 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:44.137865 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:44.137874 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:44.137874 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:44.137880 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:44.139529 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:44.140005 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:44.140007 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:44.140008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:44.140069 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:44.140312 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:44.140313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:44.140313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:44.140514 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:44.140580 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:44.140755 (+ 175us) server_negotiation.cc:299] Negotiation successful
0812 00:03:44.140850 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":95,"threads_started":1}
I20260812 00:03:44.140973 20011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:44.131748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:39655 (local address 127.0.0.1:53310)
0812 00:03:44.131797 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:44.131807 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:44.131842 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:44.132269 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:44.132270 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:44.132651 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:44.132698 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:44.132700 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.134140 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.134141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:44.134780 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:44.134784 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.135484 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.135486 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:44.135607 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:44.136185 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:44.136189 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:44.137749 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:44.139604 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:44.139614 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:44.139617 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:44.139914 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:44.140128 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:44.140129 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:44.140129 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:44.140247 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:44.140579 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:44.140587 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:44.140652 (+ 65us) client_negotiation.cc:769] Sending connection context
0812 00:03:44.140734 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 00:03:44.140860 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 00:03:44.141404 20129 tablet_service.cc:1514] Processing DeleteTablet for tablet e68a8c86ebfe4686b7116a890b498f44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:03:23 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:53310
I20260812 00:03:44.142457 20250 tablet_replica.cc:330] stopping tablet replica
I20260812 00:03:44.142562 20250 raft_consensus.cc:2229] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:03:44.142637 20250 raft_consensus.cc:2258] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:03:44.142949 20250 ts_tablet_manager.cc:1905] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:03:44.145227 20250 ts_tablet_manager.cc:1918] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:03:44.145303 20250 log.cc:1196] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/e68a8c86ebfe4686b7116a890b498f44
I20260812 00:03:44.145509 20250 ts_tablet_manager.cc:1939] T e68a8c86ebfe4686b7116a890b498f44 P edf1bf3b223f4ed28073b7ae3776af5a: Deleting consensus metadata
I20260812 00:03:44.146057 19649 catalog_manager.cc:4841] TS edf1bf3b223f4ed28073b7ae3776af5a (127.25.103.66:39655): tablet e68a8c86ebfe4686b7116a890b498f44 (table test-table [id=5abca9b42b8e485d9840885036f767fa]) successfully deleted
W20260812 00:03:44.211436 20247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:44.211663 20247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:44.211685 20247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:44.212839 20247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:44.212879 20247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:44.212905 20247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:03:44.214509 20247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:41041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:42591
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=38981
--tserver_master_addrs=127.25.103.126:42583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:03:44.214745 20247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:44.214959 20247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:44.219955 20261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:44.219972 20266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:44.219971 20257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:44.220255 20247 server_base.cc:1034] running on GCE node
I20260812 00:03:44.220643 20247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:44.220896 20247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:44.222036 20247 hybrid_clock.cc:648] HybridClock initialized: now 1786493024221996 us; error 73 us; skew 500 ppm
Aug 12 00:03:44 dist-test-slave-vpvm krb5kdc[18619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493024, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:44.224666 20247 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:03:44.225147 20247 webserver.cc:460] Webserver started at http://127.25.103.67:38981/ using document root <none> and password file <none>
I20260812 00:03:44.225354 20247 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:44.225412 20247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:44.226838 20247 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:44.227442 20284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:44.227624 20247 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:44.227716 20247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "4ddacdf86a3942c6b41059987c15f407"
format_stamp: "Formatted at 2026-08-12 00:03:23 on dist-test-slave-vpvm"
server_key: "8d7d3d641876b44e5e8d08abbc7e6712"
server_key_iv: "0d0d498922cf7ea2f7a6aae474106dfd"
server_key_version: "encryptionkey@0"
I20260812 00:03:44.228057 20247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:44.243187 20247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:44.245545 20247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:44.245676 20247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:44.246026 20247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:03:44.246484 20247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:03:44.246524 20247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:44.246547 20247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:03:44.246559 20247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:44.253439 20247 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:42591
I20260812 00:03:44.253705 20465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:42591 every 8 connection(s)
I20260812 00:03:44.253937 20247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:03:44.259820 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 20247
Aug 12 00:03:44 dist-test-slave-vpvm krb5kdc[18619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493024, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:03:44.265777 20006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:44.254875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:45633 (local address 127.25.103.126:42583)
0812 00:03:44.254936 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:44.254938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:44.255193 (+ 255us) server_negotiation.cc:407] Connection header received
0812 00:03:44.255896 (+ 703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:44.255898 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:44.255912 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:44.255982 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:44.257206 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.258001 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.259018 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.259222 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.259282 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:44.262285 (+ 3003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:44.262287 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:44.262287 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:44.262296 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:44.264015 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:44.264576 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:44.264577 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:44.264577 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:44.264646 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:44.265018 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:44.265019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:44.265019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:44.265147 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:44.265217 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:44.265578 (+ 361us) server_negotiation.cc:299] Negotiation successful
0812 00:03:44.265668 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:03:44.265928 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:44.254844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:45633)
0812 00:03:44.255026 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:44.255106 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:44.255776 (+ 670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:44.256051 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:44.256055 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:44.256816 (+ 761us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:44.257105 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:44.257112 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.258096 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.258098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:44.258927 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:44.258930 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.259329 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.259331 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:44.259451 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:44.260009 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:44.260020 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:44.262059 (+ 2039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:44.264118 (+ 2059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:44.264135 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:44.264138 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:44.264498 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:44.264734 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:44.264735 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:44.264736 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:44.264912 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:44.265220 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:44.265226 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:44.265414 (+ 188us) client_negotiation.cc:769] Sending connection context
0812 00:03:44.265520 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 00:03:44.265668 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":111,"threads_started":1}
I20260812 00:03:44.266428 20466 heartbeater.cc:347] Connected to a master server at 127.25.103.126:42583
I20260812 00:03:44.266541 20466 heartbeater.cc:464] Registering TS with master...
I20260812 00:03:44.266582 20471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:44.260233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41020 (local address 127.25.103.126:42583)
0812 00:03:44.260342 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:44.260344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:44.260452 (+ 108us) server_negotiation.cc:407] Connection header received
0812 00:03:44.260529 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:44.260530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:44.260540 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:44.260598 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:44.261225 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.261765 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.262601 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.262800 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.262854 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:44.263919 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:44.263921 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:44.263921 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:44.263928 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:44.265338 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:44.265729 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:44.265730 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:44.265730 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:44.265795 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:44.266115 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:44.266116 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:44.266116 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:44.266251 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:44.266419 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:44.266452 (+ 33us) server_negotiation.cc:299] Negotiation successful
0812 00:03:44.266518 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":57,"threads_started":1}
I20260812 00:03:44.266732 20466 heartbeater.cc:511] Master 127.25.103.126:42583 requested a full tablet report, sending...
I20260812 00:03:44.267097 19678 ts_manager.cc:194] Registered new tserver with Master: 4ddacdf86a3942c6b41059987c15f407 (127.25.103.67:42591)
I20260812 00:03:44.267431 19678 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:45633
I20260812 00:03:44.268013 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:03:44.271065 20471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:44.268360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41026 (local address 127.25.103.126:42583)
0812 00:03:44.268414 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:44.268415 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:44.268558 (+ 143us) server_negotiation.cc:407] Connection header received
0812 00:03:44.268634 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:44.268635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:44.268686 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:44.268782 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:03:44.268880 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.269612 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.270465 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.270675 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.270731 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:44.270835 (+ 104us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:03:44.270878 (+ 43us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 00:03:44.271020 (+ 142us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41026: token expired
Metrics: {"server-negotiator.queue_time_us":26}
W20260812 00:03:44.271109 20471 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41026: token expired
W20260812 00:03:44.271257 19543 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.25.103.126:42583)
I20260812 00:03:44.276891 20471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:44.271511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41028 (local address 127.25.103.126:42583)
0812 00:03:44.271551 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:44.271552 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:44.271574 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:03:44.271621 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:44.271622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:44.271630 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:44.271669 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:44.272090 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.272540 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.273193 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.273368 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.273418 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:44.274607 (+ 1189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:44.274608 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:44.274609 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:44.274615 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:44.276008 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:44.276336 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:44.276337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:44.276338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:44.276391 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:44.276525 (+ 134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:44.276525 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:44.276525 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:44.276620 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:44.276686 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:44.276750 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 00:03:44.276812 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:03:44.278115 19678 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41028:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:03:44.279680 19678 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:03:44.281711 19896 tablet_service.cc:1467] Processing CreateTablet for tablet a0cdb84e847349babeac82c7a6db1f81 (DEFAULT_TABLE table=test-table [id=fd59791c7aa441e5a0c375cadf3faf8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:03:44.281909 19896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0cdb84e847349babeac82c7a6db1f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:44.281934 20129 tablet_service.cc:1467] Processing CreateTablet for tablet a0cdb84e847349babeac82c7a6db1f81 (DEFAULT_TABLE table=test-table [id=fd59791c7aa441e5a0c375cadf3faf8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:03:44.282176 20129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0cdb84e847349babeac82c7a6db1f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:44.283496 20045 tablet_bootstrap.cc:492] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a: Bootstrap starting.
I20260812 00:03:44.283535 19829 tablet_bootstrap.cc:492] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9: Bootstrap starting.
I20260812 00:03:44.283833 19829 tablet_bootstrap.cc:654] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:44.284030 20045 tablet_bootstrap.cc:654] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:44.284355 19829 tablet_bootstrap.cc:492] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9: No bootstrap required, opened a new log
I20260812 00:03:44.284399 19829 ts_tablet_manager.cc:1397] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260812 00:03:44.284512 19829 raft_consensus.cc:348] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } }
I20260812 00:03:44.284571 19829 raft_consensus.cc:374] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:44.284598 19829 raft_consensus.cc:729] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0349898a864ce693b02e7fa43f92b9, State: Initialized, Role: FOLLOWER
I20260812 00:03:44.284636 20045 tablet_bootstrap.cc:492] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a: No bootstrap required, opened a new log
I20260812 00:03:44.284634 19829 consensus_queue.cc:260] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } }
I20260812 00:03:44.284674 20045 ts_tablet_manager.cc:1397] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:44.284713 19829 ts_tablet_manager.cc:1428] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:44.284946 20045 raft_consensus.cc:348] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } }
I20260812 00:03:44.285024 20045 raft_consensus.cc:374] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:44.285073 20045 raft_consensus.cc:729] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf1bf3b223f4ed28073b7ae3776af5a, State: Initialized, Role: FOLLOWER
I20260812 00:03:44.285123 20045 consensus_queue.cc:260] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } }
I20260812 00:03:44.285216 20045 ts_tablet_manager.cc:1428] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:03:44.285881 20011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:44.281488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:42591 (local address 127.0.0.1:50744)
0812 00:03:44.281534 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:44.281544 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:44.281578 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:44.282157 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:44.282159 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:44.282163 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:44.282212 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:44.282213 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.283616 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.283617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:44.284762 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:44.284766 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.285641 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.285642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:44.285708 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:44.285712 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:03:44.285766 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 00:03:44.285810 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 00:03:44.285903 20476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:44.281623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50744 (local address 127.25.103.67:42591)
0812 00:03:44.281847 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:44.281852 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:44.281862 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:03:44.281913 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:44.281916 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:44.281932 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:44.282277 (+ 345us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:44.282359 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.283388 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.284854 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.285568 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.285632 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:44.285693 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:44.285785 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 00:03:44.285828 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":122,"threads_started":1}
I20260812 00:03:44.286631 20364 tablet_service.cc:1467] Processing CreateTablet for tablet a0cdb84e847349babeac82c7a6db1f81 (DEFAULT_TABLE table=test-table [id=fd59791c7aa441e5a0c375cadf3faf8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:03:44.286906 20364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0cdb84e847349babeac82c7a6db1f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:44.289561 20480 tablet_bootstrap.cc:492] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407: Bootstrap starting.
I20260812 00:03:44.290175 20480 tablet_bootstrap.cc:654] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:44.290640 20480 log.cc:824] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:44.291328 20480 tablet_bootstrap.cc:492] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407: No bootstrap required, opened a new log
I20260812 00:03:44.291385 20480 ts_tablet_manager.cc:1397] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:03:44.292837 20480 raft_consensus.cc:348] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } }
I20260812 00:03:44.293002 20480 raft_consensus.cc:374] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:44.293026 20480 raft_consensus.cc:729] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ddacdf86a3942c6b41059987c15f407, State: Initialized, Role: FOLLOWER
I20260812 00:03:44.293131 20480 consensus_queue.cc:260] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } }
I20260812 00:03:44.293391 20480 ts_tablet_manager.cc:1428] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:03:44.293519 20466 heartbeater.cc:503] Master 127.25.103.126:42583 was elected leader, sending a full tablet report...
I20260812 00:03:44.355832 20482 raft_consensus.cc:482] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:03:44.355986 20482 raft_consensus.cc:504] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } }
I20260812 00:03:44.356333 20482 leader_election.cc:288] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e0349898a864ce693b02e7fa43f92b9 (127.25.103.65:41905), edf1bf3b223f4ed28073b7ae3776af5a (127.25.103.66:39655)
I20260812 00:03:44.359431 20012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:44.356648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:35707 (local address 127.25.103.65:41905)
0812 00:03:44.356757 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:44.356759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:44.356769 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:03:44.356802 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:44.356803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:44.356814 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:44.356879 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:44.357060 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.357688 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.358697 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.359075 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.359132 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:44.359139 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:44.359317 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 00:03:44.359359 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 00:03:44.359448 20249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:44.356698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:33561 (local address 127.25.103.66:39655)
0812 00:03:44.356741 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:44.356743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:44.356865 (+ 122us) server_negotiation.cc:407] Connection header received
0812 00:03:44.356998 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:44.357000 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:44.357031 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:44.357097 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:44.357243 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.357731 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.358710 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.359142 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.359224 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:44.359309 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:44.359332 (+ 23us) server_negotiation.cc:299] Negotiation successful
0812 00:03:44.359368 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:03:44.359444 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:44.356556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:41905 (local address 127.25.103.67:35707)
0812 00:03:44.356621 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:44.356635 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:44.356690 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:44.356874 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:44.356876 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:44.356878 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:44.356962 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:44.356964 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.357781 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.357782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:44.358606 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:44.358609 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.359152 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.359153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:44.359236 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:44.359241 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:03:44.359293 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 00:03:44.359336 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":35}
I20260812 00:03:44.359460 20483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:44.356582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:39655 (local address 127.25.103.67:33561)
0812 00:03:44.356798 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:44.356807 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:44.356893 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:44.357113 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:44.357114 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:44.357116 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:44.357181 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:44.357183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.357819 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.357820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:44.358620 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:44.358623 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.359221 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.359222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:44.359278 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:44.359283 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:03:44.359322 (+ 39us) client_negotiation.cc:240] Negotiation successful
0812 00:03:44.359359 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":112,"threads_started":1}
I20260812 00:03:44.359826 20164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0cdb84e847349babeac82c7a6db1f81" candidate_uuid: "4ddacdf86a3942c6b41059987c15f407" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" is_pre_election: true
I20260812 00:03:44.359823 19930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0cdb84e847349babeac82c7a6db1f81" candidate_uuid: "4ddacdf86a3942c6b41059987c15f407" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0349898a864ce693b02e7fa43f92b9" is_pre_election: true
I20260812 00:03:44.359982 20164 raft_consensus.cc:2454] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ddacdf86a3942c6b41059987c15f407 in term 0.
I20260812 00:03:44.359992 19930 raft_consensus.cc:2454] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ddacdf86a3942c6b41059987c15f407 in term 0.
I20260812 00:03:44.360215 20287 leader_election.cc:302] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ddacdf86a3942c6b41059987c15f407, edf1bf3b223f4ed28073b7ae3776af5a; no voters:
I20260812 00:03:44.360391 20482 raft_consensus.cc:2781] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:03:44.360440 20482 raft_consensus.cc:482] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:03:44.360458 20482 raft_consensus.cc:3037] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:03:44.361217 20482 raft_consensus.cc:504] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } }
I20260812 00:03:44.361351 20482 leader_election.cc:288] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [CANDIDATE]: Term 1 election: Requested vote from peers 9e0349898a864ce693b02e7fa43f92b9 (127.25.103.65:41905), edf1bf3b223f4ed28073b7ae3776af5a (127.25.103.66:39655)
I20260812 00:03:44.361519 19930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0cdb84e847349babeac82c7a6db1f81" candidate_uuid: "4ddacdf86a3942c6b41059987c15f407" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0349898a864ce693b02e7fa43f92b9"
I20260812 00:03:44.361528 20164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0cdb84e847349babeac82c7a6db1f81" candidate_uuid: "4ddacdf86a3942c6b41059987c15f407" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf1bf3b223f4ed28073b7ae3776af5a"
I20260812 00:03:44.361614 20164 raft_consensus.cc:3037] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:03:44.361613 19930 raft_consensus.cc:3037] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:03:44.362370 20164 raft_consensus.cc:2454] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ddacdf86a3942c6b41059987c15f407 in term 1.
I20260812 00:03:44.362547 20287 leader_election.cc:302] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ddacdf86a3942c6b41059987c15f407, edf1bf3b223f4ed28073b7ae3776af5a; no voters:
I20260812 00:03:44.362646 20482 raft_consensus.cc:2781] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:03:44.362840 19930 raft_consensus.cc:2454] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ddacdf86a3942c6b41059987c15f407 in term 1.
I20260812 00:03:44.362848 20482 raft_consensus.cc:686] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [term 1 LEADER]: Becoming Leader. State: Replica: 4ddacdf86a3942c6b41059987c15f407, State: Running, Role: LEADER
I20260812 00:03:44.362955 20482 consensus_queue.cc:237] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } }
I20260812 00:03:44.363883 19678 catalog_manager.cc:5495] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ddacdf86a3942c6b41059987c15f407 (127.25.103.67). New cstate: current_term: 1 leader_uuid: "4ddacdf86a3942c6b41059987c15f407" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } health_report { overall_health: UNKNOWN } } }
W20260812 00:03:44.369490 20243 tablet.cc:2369] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:03:44.380688 20476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:44.378118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50760 (local address 127.25.103.67:42591)
0812 00:03:44.378175 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:44.378177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:44.378185 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:03:44.378223 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:44.378224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:44.378241 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:44.378304 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:03:44.378461 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.378960 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.379796 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:44.380003 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:44.380067 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:44.380301 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:03:44.380426 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:03:44.380501 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:44.380541 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 00:03:44.380562 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:03:44.382678 19930 raft_consensus.cc:1261] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Refusing update from remote peer 4ddacdf86a3942c6b41059987c15f407: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:03:44.382676 20164 raft_consensus.cc:1261] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a [term 1 FOLLOWER]: Refusing update from remote peer 4ddacdf86a3942c6b41059987c15f407: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:03:44.383072 20484 consensus_queue.cc:1035] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:03:44.383216 20482 consensus_queue.cc:1035] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:03:44.385670 20493 mvcc.cc:205] Tried to move back new op lower bound from 7317475427868160000 to 7317475427791409152. Current Snapshot: MvccSnapshot[applied={T|T < 7317475427868160000 or (T in {7317475427868160000})}]
I20260812 00:03:44.387712 19674 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:03:44.387805 19674 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:03:44.388516 19674 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: Sending DeleteTablet for 3 replicas of tablet a0cdb84e847349babeac82c7a6db1f81
I20260812 00:03:44.388831 20129 tablet_service.cc:1514] Processing DeleteTablet for tablet a0cdb84e847349babeac82c7a6db1f81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:03:44 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:53310
I20260812 00:03:44.388837 19896 tablet_service.cc:1514] Processing DeleteTablet for tablet a0cdb84e847349babeac82c7a6db1f81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:03:44 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:40464
I20260812 00:03:44.388932 20013 tablet_replica.cc:330] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9: stopping tablet replica
I20260812 00:03:44.388934 20250 tablet_replica.cc:330] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a: stopping tablet replica
I20260812 00:03:44.388900 20364 tablet_service.cc:1514] Processing DeleteTablet for tablet a0cdb84e847349babeac82c7a6db1f81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:03:44 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:50744
I20260812 00:03:44.388934 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 19745
I20260812 00:03:44.388975 20013 raft_consensus.cc:2229] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:03:44.388980 20250 raft_consensus.cc:2229] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:03:44.389025 20250 raft_consensus.cc:2258] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:03:44.389030 20013 raft_consensus.cc:2258] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:03:44.389154 20504 tablet_replica.cc:330] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407: stopping tablet replica
I20260812 00:03:44.389238 20504 raft_consensus.cc:2229] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:03:44.389320 20504 raft_consensus.cc:2258] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:03:44.393508 20504 ts_tablet_manager.cc:1905] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:03:44.395844 20504 ts_tablet_manager.cc:1918] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:03:44.395967 20504 log.cc:1196] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/a0cdb84e847349babeac82c7a6db1f81
I20260812 00:03:44.396356 20504 ts_tablet_manager.cc:1939] T a0cdb84e847349babeac82c7a6db1f81 P 4ddacdf86a3942c6b41059987c15f407: Deleting consensus metadata
I20260812 00:03:44.397104 19647 catalog_manager.cc:4841] TS 4ddacdf86a3942c6b41059987c15f407 (127.25.103.67:42591): tablet a0cdb84e847349babeac82c7a6db1f81 (table test-table [id=fd59791c7aa441e5a0c375cadf3faf8e]) successfully deleted
I20260812 00:03:44.401063 20250 ts_tablet_manager.cc:1905] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:03:44.402632 20250 ts_tablet_manager.cc:1918] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:03:44.402706 20250 log.cc:1196] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/a0cdb84e847349babeac82c7a6db1f81
I20260812 00:03:44.402910 20250 ts_tablet_manager.cc:1939] T a0cdb84e847349babeac82c7a6db1f81 P edf1bf3b223f4ed28073b7ae3776af5a: Deleting consensus metadata
I20260812 00:03:44.403376 19649 catalog_manager.cc:4841] TS edf1bf3b223f4ed28073b7ae3776af5a (127.25.103.66:39655): tablet a0cdb84e847349babeac82c7a6db1f81 (table test-table [id=fd59791c7aa441e5a0c375cadf3faf8e]) successfully deleted
W20260812 00:03:44.409528 19650 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.103.65:41905 (error 108)
I20260812 00:03:44.409781 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 20010
I20260812 00:03:44.422117 20011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:44.419844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:41905 (local address 127.0.0.1:40476)
0812 00:03:44.421968 (+ 2124us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:44.422065 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:41905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2066}
W20260812 00:03:44.422994 19650 catalog_manager.cc:4584] TS 9e0349898a864ce693b02e7fa43f92b9 (127.25.103.65:41905): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a0cdb84e847349babeac82c7a6db1f81: Network error: Client connection negotiation failed: client connection to 127.25.103.65:41905: connect: Connection refused (error 111)
I20260812 00:03:44.430130 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 20247
I20260812 00:03:44.445356 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 19614
I20260812 00:04:04.463438 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:42583
--webserver_interface=127.25.103.126
--webserver_port=45997
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:41041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:42583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:04.552135 20508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:04.552361 20508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:04.552383 20508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:04.553680 20508 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 00:04:04.553740 20508 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 00:04:04.553759 20508 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 00:04:04.553773 20508 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:04.553787 20508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:04.553813 20508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:04.553846 20508 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:04.553874 20508 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:04.555697 20508 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:41041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:42583
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:42583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=45997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:04.555963 20508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:04.556208 20508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:04.561790 20518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:04.561797 20515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:04.562109 20508 server_base.cc:1034] running on GCE node
W20260812 00:04:04.561785 20521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:04.562539 20508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:04.562868 20508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:04.564045 20508 hybrid_clock.cc:648] HybridClock initialized: now 1786493044563998 us; error 63 us; skew 500 ppm
Aug 12 00:04:04 dist-test-slave-vpvm krb5kdc[18619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493044, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:04.566859 20508 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:04:04.567342 20508 webserver.cc:460] Webserver started at http://127.25.103.126:45997/ using document root <none> and password file <none>
I20260812 00:04:04.567584 20508 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:04.567633 20508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:04.569168 20508 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:04.570212 20534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:04.570539 20508 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:04.570655 20508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "0a07c6149b624723bf8a6ab3a4e0f84d"
format_stamp: "Formatted at 2026-08-12 00:03:22 on dist-test-slave-vpvm"
server_key: "db8d8822450a155ebeb23744debad4a0"
server_key_iv: "4e696f10220c784bda478e218176d8c0"
server_key_version: "encryptionkey@0"
I20260812 00:04:04.571051 20508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:04.586318 20508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:04.588584 20508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:04.588734 20508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:04.593103 20508 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:42583
I20260812 00:04:04.593145 20623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:42583 every 8 connection(s)
I20260812 00:04:04.593518 20508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:04.595027 20624 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:04:04.595690 20624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: Bootstrap starting.
I20260812 00:04:04.599972 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 20508
I20260812 00:04:04.600364 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:41905
--local_ip_for_outbound_sockets=127.25.103.65
--tserver_master_addrs=127.25.103.126:42583
--webserver_port=44531
--webserver_interface=127.25.103.65
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:41041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:04:04.606086 20624 log.cc:824] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:04.608290 20624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:04:04.608572 20624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: Bootstrap complete.
I20260812 00:04:04.610776 20624 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42583 } }
I20260812 00:04:04.610996 20624 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a07c6149b624723bf8a6ab3a4e0f84d, State: Initialized, Role: FOLLOWER
I20260812 00:04:04.611164 20624 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42583 } }
I20260812 00:04:04.611241 20624 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:04.611291 20624 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:04.611338 20624 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 2 FOLLOWER]: Advancing to term 3
I20260812 00:04:04.612298 20624 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42583 } }
I20260812 00:04:04.612392 20624 leader_election.cc:302] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a07c6149b624723bf8a6ab3a4e0f84d; no voters:
I20260812 00:04:04.612557 20624 leader_election.cc:288] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 00:04:04.612612 20630 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 3 FOLLOWER]: Leader election won for term 3
I20260812 00:04:04.612730 20630 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [term 3 LEADER]: Becoming Leader. State: Replica: 0a07c6149b624723bf8a6ab3a4e0f84d, State: Running, Role: LEADER
I20260812 00:04:04.612828 20624 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:04.612814 20630 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42583 } }
I20260812 00:04:04.613107 20631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42583 } } }
I20260812 00:04:04.613236 20631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:04.613111 20632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a07c6149b624723bf8a6ab3a4e0f84d. Latest consensus state: current_term: 3 leader_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a07c6149b624723bf8a6ab3a4e0f84d" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 42583 } } }
I20260812 00:04:04.613493 20632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:04.614578 20655 catalog_manager.cc:1259] Loaded cluster ID: d08703095ab14db498fccc77fbe3d416
I20260812 00:04:04.614627 20655 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: loading cluster ID for follower catalog manager: success
I20260812 00:04:04.615772 20655 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0a07c6149b624723bf8a6ab3a4e0f84d: acquiring CA information for follower catalog manager: success
F20260812 00:04:04.616146 20655 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f67807689ad google::LogMessage::Fail() at ??:0
@ 0x7f678076b88a google::LogMessage::SendToLog() at ??:0
@ 0x7f67807684de google::LogMessage::Flush() at ??:0
@ 0x7f6780769a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f6782ed5104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f67886c56b9 kudu::master::CatalogManager::LoadTspkEntries() at ??:0
@ 0x7f67886c5989 kudu::master::CatalogManager::PrepareFollowerTokenVerifier() at ??:0
@ 0x7f67886c5e4e kudu::master::CatalogManager::PrepareFollower() at ??:0
@ 0x7f67886c88c2 kudu::master::CatalogManagerBgTasks::Run() at ??:0
@ 0x7f678262b954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f678348f6db start_thread at ??:0
@ 0x7f677f26661f clone at ??:0
W20260812 00:04:04.700299 20627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:04.700657 20627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:04.700697 20627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:04.701903 20627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:04.701987 20627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:04.702028 20627 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:04:04.703878 20627 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:41041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:41905
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=44531
--tserver_master_addrs=127.25.103.126:42583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:04.704144 20627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:04.704375 20627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:04.710669 20693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:04.710709 20691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:04.710670 20699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:04.711042 20627 server_base.cc:1034] running on GCE node
I20260812 00:04:04.711254 20627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:04.711545 20627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:04.712715 20627 hybrid_clock.cc:648] HybridClock initialized: now 1786493044712702 us; error 29 us; skew 500 ppm
Aug 12 00:04:04 dist-test-slave-vpvm krb5kdc[18619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493044, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:04.716990 20627 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:04:04.717738 20627 webserver.cc:460] Webserver started at http://127.25.103.65:44531/ using document root <none> and password file <none>
I20260812 00:04:04.718077 20627 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:04.718151 20627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:04.719995 20627 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:04:04.720863 20715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:04.721060 20627 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:04:04.721141 20627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "9e0349898a864ce693b02e7fa43f92b9"
format_stamp: "Formatted at 2026-08-12 00:03:22 on dist-test-slave-vpvm"
server_key: "71de6faefe88001cd917ebce16efa7d6"
server_key_iv: "3d26b9cf18d2eb7dc7079e130b498a45"
server_key_version: "encryptionkey@0"
I20260812 00:04:04.721504 20627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:04.735433 20627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:04.737880 20627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:04.738092 20627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:04.738348 20627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:04.738821 20728 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 00:04:04.740860 20627 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 00:04:04.740921 20627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 00:04:04.740957 20627 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 00:04:04.741601 20627 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 00:04:04.741636 20627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 00:04:04.741724 20728 tablet_bootstrap.cc:492] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9: Bootstrap starting.
I20260812 00:04:04.749974 20627 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:41905
I20260812 00:04:04.750036 20902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:41905 every 8 connection(s)
I20260812 00:04:04.750507 20627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:04:04.753515 20728 log.cc:824] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:04.755733 20728 tablet_bootstrap.cc:492] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:04:04.756024 20728 tablet_bootstrap.cc:492] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9: Bootstrap complete.
I20260812 00:04:04.756958 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 20627
I20260812 00:04:04.757099 20728 ts_tablet_manager.cc:1397] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.009s
I20260812 00:04:04.757252 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:39655
--local_ip_for_outbound_sockets=127.25.103.66
--tserver_master_addrs=127.25.103.126:42583
--webserver_port=36917
--webserver_interface=127.25.103.66
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:41041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:04:04.758337 20728 raft_consensus.cc:348] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } }
I20260812 00:04:04.758594 20728 raft_consensus.cc:729] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0349898a864ce693b02e7fa43f92b9, State: Initialized, Role: FOLLOWER
I20260812 00:04:04.758738 20728 consensus_queue.cc:260] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } }
I20260812 00:04:04.759016 20728 ts_tablet_manager.cc:1428] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
W20260812 00:04:04.852218 20906 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:04:04.751299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:40989)
0812 00:04:04.751505 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:04.751558 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:04.752245 (+ 687us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:04.851930 (+ 99685us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":96,"threads_started":1}
W20260812 00:04:04.852514 20903 heartbeater.cc:644] Failed to heartbeat to 127.25.103.126:42583 (0 consecutive failures): Network error: Failed to ping master at 127.25.103.126:42583: Client connection negotiation failed: client connection to 127.25.103.126:42583: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:04:04.852856 20906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:04.852748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:40705)
0812 00:04:04.852794 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:04.852835 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 00:04:04.853329 20906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:04.853231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:44423)
0812 00:04:04.853280 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:04.853309 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 00:04:04.853464 20903 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:04:04.874554 20910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:04.874764 20910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:04.874790 20910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:04.875984 20910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:04.876021 20910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:04.876049 20910 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:04:04.877666 20910 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:41041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:39655
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=36917
--tserver_master_addrs=127.25.103.126:42583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:04.877873 20910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:04.878118 20910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:04.883106 20923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:04.883180 20910 server_base.cc:1034] running on GCE node
W20260812 00:04:04.883142 20917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:04.883152 20919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:04.883524 20910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:04.883767 20910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:04.884946 20910 hybrid_clock.cc:648] HybridClock initialized: now 1786493044884933 us; error 28 us; skew 500 ppm
Aug 12 00:04:04 dist-test-slave-vpvm krb5kdc[18619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493044, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:04.887624 20910 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:04:04.888104 20910 webserver.cc:460] Webserver started at http://127.25.103.66:36917/ using document root <none> and password file <none>
I20260812 00:04:04.888340 20910 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:04.888392 20910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:04.889761 20910 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:04.890589 20935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:04.890779 20910 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:04:04.890869 20910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "edf1bf3b223f4ed28073b7ae3776af5a"
format_stamp: "Formatted at 2026-08-12 00:03:23 on dist-test-slave-vpvm"
server_key: "56947d52de20c1896ae79e58f87be85c"
server_key_iv: "9b96647ff8838943b19f1f667386aab8"
server_key_version: "encryptionkey@0"
I20260812 00:04:04.891237 20910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:04.903139 20910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:04.905411 20910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:04.905670 20910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:04.905925 20910 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:04.906288 20910 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:04.906324 20910 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:04.906353 20910 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:04.906371 20910 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:04.912266 20910 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:39655
I20260812 00:04:04.912324 21119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:39655 every 8 connection(s)
I20260812 00:04:04.912658 20910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:04:04.913997 21131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:04.913436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:36577)
0812 00:04:04.913703 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:04.913809 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":81,"threads_started":1}
W20260812 00:04:04.914410 21128 heartbeater.cc:644] Failed to heartbeat to 127.25.103.126:42583 (0 consecutive failures): Network error: Failed to ping master at 127.25.103.126:42583: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
I20260812 00:04:04.914763 21131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:04.914639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:44169)
0812 00:04:04.914706 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:04.914739 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 00:04:04.914783 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 20910
I20260812 00:04:04.915038 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:42591
--local_ip_for_outbound_sockets=127.25.103.67
--tserver_master_addrs=127.25.103.126:42583
--webserver_port=38981
--webserver_interface=127.25.103.67
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:41041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:04:04.916899 21131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:04.916781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:32829)
0812 00:04:04.916839 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:04.916876 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 00:04:04.917032 21128 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:04:05.000068 21132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:05.000290 21132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:05.000315 21132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:05.001483 21132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:05.001531 21132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:05.001559 21132 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:04:05.003051 21132 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:41041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:42591
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=38981
--tserver_master_addrs=127.25.103.126:42583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:05.003293 21132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:05.003525 21132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:05.008574 21138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:05.008600 21132 server_base.cc:1034] running on GCE node
W20260812 00:04:05.008566 21139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:05.008570 21141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:05.008936 21132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:05.009176 21132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:05.010331 21132 hybrid_clock.cc:648] HybridClock initialized: now 1786493045010317 us; error 28 us; skew 500 ppm
Aug 12 00:04:05 dist-test-slave-vpvm krb5kdc[18619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493045, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:05.012944 21132 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:04:05.013355 21132 webserver.cc:460] Webserver started at http://127.25.103.67:38981/ using document root <none> and password file <none>
I20260812 00:04:05.013573 21132 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:05.013619 21132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:05.014972 21132 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:05.015596 21151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:05.015755 21132 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:05.015825 21132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "4ddacdf86a3942c6b41059987c15f407"
format_stamp: "Formatted at 2026-08-12 00:03:23 on dist-test-slave-vpvm"
server_key: "8d7d3d641876b44e5e8d08abbc7e6712"
server_key_iv: "0d0d498922cf7ea2f7a6aae474106dfd"
server_key_version: "encryptionkey@0"
I20260812 00:04:05.016183 21132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:05.034919 21132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:05.037272 21132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:05.037436 21132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:05.037700 21132 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:05.038066 21132 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:05.038107 21132 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:05.038132 21132 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:05.038159 21132 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:05.044742 21132 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:42591
I20260812 00:04:05.044809 21348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:42591 every 8 connection(s)
I20260812 00:04:05.045162 21132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:04:05.046308 21352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:05.045857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:37359)
0812 00:04:05.046084 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:05.046162 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":94,"threads_started":1}
W20260812 00:04:05.046734 21350 heartbeater.cc:644] Failed to heartbeat to 127.25.103.126:42583 (0 consecutive failures): Network error: Failed to ping master at 127.25.103.126:42583: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
I20260812 00:04:05.047030 21352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:05.046940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:45839)
0812 00:04:05.046985 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:05.047012 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 00:04:05.047394 21352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:05.047265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:38945)
0812 00:04:05.047341 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:05.047372 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 00:04:05.047529 21350 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:04:05.051215 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 21132
I20260812 00:04:05.854182 21357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:05.853909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:33835)
0812 00:04:05.854063 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:05.854109 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":98,"threads_started":1}
I20260812 00:04:05.917645 21358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:05.917404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:38577)
0812 00:04:05.917540 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:05.917582 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":65,"threads_started":1}
I20260812 00:04:06.048072 21360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:06.047859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:38127)
0812 00:04:06.047988 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:06.048022 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":61,"threads_started":1}
I20260812 00:04:06.503260 21361 raft_consensus.cc:482] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:06.503394 21361 raft_consensus.cc:504] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } }
I20260812 00:04:06.503757 21361 leader_election.cc:288] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ddacdf86a3942c6b41059987c15f407 (127.25.103.67:42591), edf1bf3b223f4ed28073b7ae3776af5a (127.25.103.66:39655)
Aug 12 00:04:06 dist-test-slave-vpvm krb5kdc[18619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493044, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.67@KRBTEST.COM
Aug 12 00:04:06 dist-test-slave-vpvm krb5kdc[18619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493044, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.66@KRBTEST.COM
I20260812 00:04:06.514518 21364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:06.504040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:59621 (local address 127.25.103.66:39655)
0812 00:04:06.504173 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:06.504186 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:06.504299 (+ 113us) server_negotiation.cc:407] Connection header received
0812 00:04:06.504809 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:06.504812 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:06.504853 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:06.504978 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:06.505703 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:06.506607 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:06.507605 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:06.508008 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:06.508106 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:06.510839 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:06.510843 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:06.510843 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:06.510855 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:06.512725 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:06.513072 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:06.513075 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:06.513075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:06.513174 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:06.513502 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:06.513503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:06.513503 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:06.513853 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:06.513994 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:06.514273 (+ 279us) server_negotiation.cc:299] Negotiation successful
0812 00:04:06.514402 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":71,"threads_started":1}
I20260812 00:04:06.514539 21365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:06.504140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:46929 (local address 127.25.103.67:42591)
0812 00:04:06.504291 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:06.504299 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:06.504322 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:04:06.504773 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:06.504775 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:06.504817 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:06.504947 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:06.505702 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:06.506603 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:06.507619 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:06.508019 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:06.508114 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:06.510442 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:06.510445 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:06.510446 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:06.510456 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:06.512561 (+ 2105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:06.513032 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:06.513036 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:06.513037 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:06.513255 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:06.513535 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:06.513587 (+ 52us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:06.513587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:06.513854 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:06.513975 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:06.514268 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 00:04:06.514402 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":69,"threads_started":1}
I20260812 00:04:06.514556 21363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:06.503978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:39655 (local address 127.25.103.65:59621)
0812 00:04:06.504206 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:06.504217 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:06.504294 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:06.505035 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:06.505038 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:06.505392 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:06.505586 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:06.505593 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:06.506702 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:06.506703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:06.507516 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:06.507519 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:06.508100 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:06.508101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:06.508211 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:06.508784 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:06.508792 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:06.510714 (+ 1922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:06.512792 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:06.512793 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:06.512793 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:06.512982 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:06.513266 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:06.513267 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:06.513267 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:06.513413 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:06.513976 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:06.513984 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:06.514104 (+ 120us) client_negotiation.cc:769] Sending connection context
0812 00:04:06.514199 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 00:04:06.514401 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":60,"thread_start_us":57,"threads_started":1}
I20260812 00:04:06.514626 21362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:06.503947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:42591 (local address 127.25.103.65:46929)
0812 00:04:06.504086 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:06.504099 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:06.504159 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:06.505036 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:06.505038 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:06.505392 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:06.505587 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:06.505593 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:06.506695 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:06.506696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:06.507521 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:06.507524 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:06.508104 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:06.508105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:06.508211 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:06.508822 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:06.508826 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:06.510329 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:06.512672 (+ 2343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:06.512679 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:06.512682 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:06.512947 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:06.513366 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:06.513367 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:06.513368 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:06.513447 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:06.513978 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:06.513986 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:06.514104 (+ 118us) client_negotiation.cc:769] Sending connection context
0812 00:04:06.514199 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 00:04:06.514474 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":177,"thread_start_us":80,"threads_started":1}
W20260812 00:04:06.515383 20717 leader_election.cc:341] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4ddacdf86a3942c6b41059987c15f407 (127.25.103.67:42591): Not found: Tablet not found: a0cdb84e847349babeac82c7a6db1f81
W20260812 00:04:06.515766 20718 leader_election.cc:341] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer edf1bf3b223f4ed28073b7ae3776af5a (127.25.103.66:39655): Not found: Tablet not found: a0cdb84e847349babeac82c7a6db1f81
I20260812 00:04:06.515833 20718 leader_election.cc:302] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0349898a864ce693b02e7fa43f92b9; no voters: 4ddacdf86a3942c6b41059987c15f407, edf1bf3b223f4ed28073b7ae3776af5a
I20260812 00:04:06.515959 21361 raft_consensus.cc:2726] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:04:06.854868 21363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:06.854701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:50001)
0812 00:04:06.854790 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:06.854827 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260812 00:04:06.918542 21367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:06.918245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:44775)
0812 00:04:06.918407 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:06.918469 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":82,"threads_started":1}
I20260812 00:04:07.048827 21368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:07.048574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:57377)
0812 00:04:07.048739 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:07.048782 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":67,"threads_started":1}
I20260812 00:04:07.855595 21370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:07.855367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:56603)
0812 00:04:07.855503 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:07.855546 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":70,"threads_started":1}
I20260812 00:04:07.919533 21372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:07.919075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:56691)
0812 00:04:07.919439 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:07.919482 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":130,"threads_started":1}
I20260812 00:04:08.049643 21375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:08.049374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:60939)
0812 00:04:08.049531 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:08.049580 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":71,"threads_started":1}
I20260812 00:04:08.686240 21377 raft_consensus.cc:482] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:08.686347 21377 raft_consensus.cc:504] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } }
I20260812 00:04:08.686515 21377 leader_election.cc:288] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ddacdf86a3942c6b41059987c15f407 (127.25.103.67:42591), edf1bf3b223f4ed28073b7ae3776af5a (127.25.103.66:39655)
W20260812 00:04:08.687026 20718 leader_election.cc:341] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer edf1bf3b223f4ed28073b7ae3776af5a (127.25.103.66:39655): Not found: Tablet not found: a0cdb84e847349babeac82c7a6db1f81
W20260812 00:04:08.687129 20717 leader_election.cc:341] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4ddacdf86a3942c6b41059987c15f407 (127.25.103.67:42591): Not found: Tablet not found: a0cdb84e847349babeac82c7a6db1f81
I20260812 00:04:08.687196 20717 leader_election.cc:302] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0349898a864ce693b02e7fa43f92b9; no voters: 4ddacdf86a3942c6b41059987c15f407, edf1bf3b223f4ed28073b7ae3776af5a
I20260812 00:04:08.687269 21377 raft_consensus.cc:2726] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:04:08.856463 21378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:08.856146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:35233)
0812 00:04:08.856337 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:08.856390 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":92,"threads_started":1}
I20260812 00:04:08.920565 21381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:08.920213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:45549)
0812 00:04:08.920439 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:08.920489 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":88,"threads_started":1}
I20260812 00:04:09.050299 21382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:09.050083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:53291)
0812 00:04:09.050205 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:09.050237 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":63,"threads_started":1}
I20260812 00:04:09.857535 21385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:09.857230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:53229)
0812 00:04:09.857381 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:09.857480 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":70,"threads_started":1}
I20260812 00:04:09.921391 21386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:09.921117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:49145)
0812 00:04:09.921298 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:09.921339 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":85,"threads_started":1}
I20260812 00:04:10.051133 21390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:10.050884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:51681)
0812 00:04:10.051034 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:10.051082 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":69,"threads_started":1}
I20260812 00:04:10.626531 21393 raft_consensus.cc:482] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:10.626636 21393 raft_consensus.cc:504] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } }
I20260812 00:04:10.626791 21393 leader_election.cc:288] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ddacdf86a3942c6b41059987c15f407 (127.25.103.67:42591), edf1bf3b223f4ed28073b7ae3776af5a (127.25.103.66:39655)
W20260812 00:04:10.627277 20718 leader_election.cc:341] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer edf1bf3b223f4ed28073b7ae3776af5a (127.25.103.66:39655): Not found: Tablet not found: a0cdb84e847349babeac82c7a6db1f81
W20260812 00:04:10.627378 20717 leader_election.cc:341] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4ddacdf86a3942c6b41059987c15f407 (127.25.103.67:42591): Not found: Tablet not found: a0cdb84e847349babeac82c7a6db1f81
I20260812 00:04:10.627424 20717 leader_election.cc:302] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0349898a864ce693b02e7fa43f92b9; no voters: 4ddacdf86a3942c6b41059987c15f407, edf1bf3b223f4ed28073b7ae3776af5a
I20260812 00:04:10.627496 21393 raft_consensus.cc:2726] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:04:10.858381 21394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:10.858128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:36471)
0812 00:04:10.858287 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:10.858332 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":75,"threads_started":1}
I20260812 00:04:10.922240 21395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:10.921993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:49849)
0812 00:04:10.922153 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:10.922190 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":93,"threads_started":1}
I20260812 00:04:11.051882 21396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:11.051633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:53179)
0812 00:04:11.051787 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:11.051832 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":65,"threads_started":1}
I20260812 00:04:11.859309 21397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:11.858989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:49235)
0812 00:04:11.859201 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:11.859256 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":80,"threads_started":1}
I20260812 00:04:11.923017 21398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:11.922767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:47607)
0812 00:04:11.922913 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:11.922967 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":71,"threads_started":1}
I20260812 00:04:12.052737 21399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:12.052495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:58795)
0812 00:04:12.052639 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:12.052687 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":69,"threads_started":1}
I20260812 00:04:12.860112 21400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:12.859871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:48371)
0812 00:04:12.860018 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:12.860060 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":79,"threads_started":1}
I20260812 00:04:12.923699 21401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:12.923483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:44865)
0812 00:04:12.923609 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:12.923648 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":66,"threads_started":1}
I20260812 00:04:13.053553 21402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:13.053308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:39145)
0812 00:04:13.053461 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:13.053504 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":69,"threads_started":1}
I20260812 00:04:13.860956 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:13.860701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:36147)
0812 00:04:13.860846 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:13.860895 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":71,"threads_started":1}
I20260812 00:04:13.924562 21405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:13.924254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:44565)
0812 00:04:13.924399 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:13.924446 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":69,"threads_started":1}
I20260812 00:04:14.054495 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:14.054200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:58449)
0812 00:04:14.054384 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:14.054440 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":88,"threads_started":1}
I20260812 00:04:14.775187 21408 raft_consensus.cc:482] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:14.775319 21408 raft_consensus.cc:504] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } }
I20260812 00:04:14.775477 21408 leader_election.cc:288] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ddacdf86a3942c6b41059987c15f407 (127.25.103.67:42591), edf1bf3b223f4ed28073b7ae3776af5a (127.25.103.66:39655)
W20260812 00:04:14.775868 20718 leader_election.cc:341] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer edf1bf3b223f4ed28073b7ae3776af5a (127.25.103.66:39655): Not found: Tablet not found: a0cdb84e847349babeac82c7a6db1f81
W20260812 00:04:14.776003 20717 leader_election.cc:341] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4ddacdf86a3942c6b41059987c15f407 (127.25.103.67:42591): Not found: Tablet not found: a0cdb84e847349babeac82c7a6db1f81
I20260812 00:04:14.776087 20717 leader_election.cc:302] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0349898a864ce693b02e7fa43f92b9; no voters: 4ddacdf86a3942c6b41059987c15f407, edf1bf3b223f4ed28073b7ae3776af5a
I20260812 00:04:14.776180 21408 raft_consensus.cc:2726] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:04:14.861824 21409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:14.861533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:39033)
0812 00:04:14.861723 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:14.861773 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":72,"threads_started":1}
I20260812 00:04:14.925443 21412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:14.925103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:48273)
0812 00:04:14.925322 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:14.925368 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":137,"threads_started":1}
I20260812 00:04:15.055315 21413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:15.055039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:33851)
0812 00:04:15.055213 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:15.055261 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":90,"threads_started":1}
I20260812 00:04:15.862612 21416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:15.862334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:34591)
0812 00:04:15.862507 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:15.862550 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":77,"threads_started":1}
I20260812 00:04:15.926173 21417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:15.925914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:49989)
0812 00:04:15.926076 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:15.926122 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":90,"threads_started":1}
I20260812 00:04:16.056066 21418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:16.055827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:46057)
0812 00:04:16.055980 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:16.056020 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":67,"threads_started":1}
I20260812 00:04:16.863476 21419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:16.863205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:58997)
0812 00:04:16.863347 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:16.863401 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":69,"threads_started":1}
I20260812 00:04:16.926901 21420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:16.926664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:51863)
0812 00:04:16.926803 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:16.926849 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":66,"threads_started":1}
I20260812 00:04:17.056900 21421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.056636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:37367)
0812 00:04:17.056808 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:17.056846 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":73,"threads_started":1}
I20260812 00:04:17.357056 21422 raft_consensus.cc:482] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:17.357206 21422 raft_consensus.cc:504] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ddacdf86a3942c6b41059987c15f407" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 42591 } } peers { permanent_uuid: "9e0349898a864ce693b02e7fa43f92b9" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 41905 } } peers { permanent_uuid: "edf1bf3b223f4ed28073b7ae3776af5a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 39655 } }
I20260812 00:04:17.357424 21422 leader_election.cc:288] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ddacdf86a3942c6b41059987c15f407 (127.25.103.67:42591), edf1bf3b223f4ed28073b7ae3776af5a (127.25.103.66:39655)
W20260812 00:04:17.358050 20717 leader_election.cc:341] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4ddacdf86a3942c6b41059987c15f407 (127.25.103.67:42591): Not found: Tablet not found: a0cdb84e847349babeac82c7a6db1f81
W20260812 00:04:17.358194 20718 leader_election.cc:341] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer edf1bf3b223f4ed28073b7ae3776af5a (127.25.103.66:39655): Not found: Tablet not found: a0cdb84e847349babeac82c7a6db1f81
I20260812 00:04:17.358260 20718 leader_election.cc:302] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0349898a864ce693b02e7fa43f92b9; no voters: 4ddacdf86a3942c6b41059987c15f407, edf1bf3b223f4ed28073b7ae3776af5a
I20260812 00:04:17.358356 21422 raft_consensus.cc:2726] T a0cdb84e847349babeac82c7a6db1f81 P 9e0349898a864ce693b02e7fa43f92b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:04:17.864439 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.864150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:50497)
0812 00:04:17.864328 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:17.864382 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":78,"threads_started":1}
I20260812 00:04:17.927887 21432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.927493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:48959)
0812 00:04:17.927732 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:17.927810 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":87,"threads_started":1}
I20260812 00:04:18.057837 21434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:18.057545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:58835)
0812 00:04:18.057735 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:18.057784 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":75,"threads_started":1}
I20260812 00:04:18.865394 21438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:18.865100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:34993)
0812 00:04:18.865278 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:18.865332 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":83,"threads_started":1}
I20260812 00:04:18.929078 21441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:18.928712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:59651)
0812 00:04:18.928922 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:18.928996 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":72,"threads_started":1}
I20260812 00:04:19.058760 21443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:19.058505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:34151)
0812 00:04:19.058660 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:19.058706 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":77,"threads_started":1}
I20260812 00:04:19.866490 21445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:19.866227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.65:37183)
0812 00:04:19.866394 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:19.866440 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":71,"threads_started":1}
I20260812 00:04:19.930174 21446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:19.929877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.66:44887)
0812 00:04:19.930064 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:19.930114 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":91,"threads_started":1}
I20260812 00:04:20.054860 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 20627
I20260812 00:04:20.065657 21447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.065213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:42583 (local address 127.25.103.67:53615)
0812 00:04:20.065541 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.065593 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.126:42583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":64,"threads_started":1}
I20260812 00:04:20.070469 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 20910
I20260812 00:04:20.089264 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 21132
2026-08-12T00:04:20Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58908 ms)
[----------] 30 tests from SecurityITest (257782 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:20 dist-test-slave-vpvm krb5kdc[21451](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:20 dist-test-slave-vpvm krb5kdc[21451](info): set up 2 sockets
Aug 12 00:04:20 dist-test-slave-vpvm krb5kdc[21451](info): commencing operation
krb5kdc: starting...
W20260812 00:04:21.344944 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.214s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:21 dist-test-slave-vpvm krb5kdc[21451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493061, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:04:21.481514 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:45891
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:39891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:45891
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:21.575995 21471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:21.576248 21471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:21.576282 21471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:21.577509 21471 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:21.577562 21471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:21.577580 21471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:21.577597 21471 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:21.577611 21471 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:21.579233 21471 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:39891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:45891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:45891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:21.579622 21471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:21.579883 21471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:04:21.585268 21471 server_base.cc:1034] running on GCE node
W20260812 00:04:21.585222 21481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:21.585230 21479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:21.585229 21484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:21.585843 21471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:21.586181 21471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:21.587354 21471 hybrid_clock.cc:648] HybridClock initialized: now 1786493061587341 us; error 28 us; skew 500 ppm
Aug 12 00:04:21 dist-test-slave-vpvm krb5kdc[21451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493061, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:21.590369 21471 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:04:21.590873 21471 webserver.cc:460] Webserver started at http://127.25.103.126:36719/ using document root <none> and password file <none>
I20260812 00:04:21.591097 21471 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:21.591150 21471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:21.591269 21471 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:21.592409 21471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "2a0619f180c44be0a8aeb12e480c2a9a"
format_stamp: "Formatted at 2026-08-12 00:04:21 on dist-test-slave-vpvm"
server_key: "e0ffaca20aef3c6deb75462b1a018b12"
server_key_iv: "88193755988ea00e74ac7b01e0f086a0"
server_key_version: "encryptionkey@0"
I20260812 00:04:21.592794 21471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "2a0619f180c44be0a8aeb12e480c2a9a"
format_stamp: "Formatted at 2026-08-12 00:04:21 on dist-test-slave-vpvm"
server_key: "e0ffaca20aef3c6deb75462b1a018b12"
server_key_iv: "88193755988ea00e74ac7b01e0f086a0"
server_key_version: "encryptionkey@0"
I20260812 00:04:21.594563 21471 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260812 00:04:21.595824 21500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:21.596045 21471 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:21.596159 21471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "2a0619f180c44be0a8aeb12e480c2a9a"
format_stamp: "Formatted at 2026-08-12 00:04:21 on dist-test-slave-vpvm"
server_key: "e0ffaca20aef3c6deb75462b1a018b12"
server_key_iv: "88193755988ea00e74ac7b01e0f086a0"
server_key_version: "encryptionkey@0"
I20260812 00:04:21.596248 21471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:21.616850 21471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:21.619508 21471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:21.619663 21471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:21.624197 21471 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:45891
I20260812 00:04:21.624271 21586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:45891 every 8 connection(s)
I20260812 00:04:21.624619 21471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:21.625594 21587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:21.628159 21587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a: Bootstrap starting.
I20260812 00:04:21.628788 21587 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:21.629094 21587 log.cc:824] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:21.629984 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 21471
I20260812 00:04:21.630100 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:21.630144 21587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a: No bootstrap required, opened a new log
I20260812 00:04:21.630302 26013 external_mini_cluster.cc:1428] Setting key cad5868820c51647c15f6c01302ba138
I20260812 00:04:21.632408 21587 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a0619f180c44be0a8aeb12e480c2a9a" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45891 } }
I20260812 00:04:21.632622 21587 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:21.632664 21587 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a0619f180c44be0a8aeb12e480c2a9a, State: Initialized, Role: FOLLOWER
I20260812 00:04:21.632797 21587 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a0619f180c44be0a8aeb12e480c2a9a" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45891 } }
I20260812 00:04:21.632876 21587 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:21.632910 21587 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:21.632961 21587 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:21.634152 21587 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a0619f180c44be0a8aeb12e480c2a9a" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45891 } }
I20260812 00:04:21.634284 21587 leader_election.cc:302] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a0619f180c44be0a8aeb12e480c2a9a; no voters:
I20260812 00:04:21.634485 21587 leader_election.cc:288] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:21.634532 21595 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:21.634760 21595 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a [term 1 LEADER]: Becoming Leader. State: Replica: 2a0619f180c44be0a8aeb12e480c2a9a, State: Running, Role: LEADER
I20260812 00:04:21.634866 21595 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a0619f180c44be0a8aeb12e480c2a9a" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45891 } }
I20260812 00:04:21.634754 21587 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:21.636407 21604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a0619f180c44be0a8aeb12e480c2a9a. Latest consensus state: current_term: 1 leader_uuid: "2a0619f180c44be0a8aeb12e480c2a9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a0619f180c44be0a8aeb12e480c2a9a" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45891 } } }
I20260812 00:04:21.636513 21604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a [sys.catalog]: This master's current role is: LEADER
W20260812 00:04:21.637147 21622 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260812 00:04:21.636767 21598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a0619f180c44be0a8aeb12e480c2a9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a0619f180c44be0a8aeb12e480c2a9a" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45891 } } }
W20260812 00:04:21.637203 21622 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:04:21.637239 21598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:21.637271 21623 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:21.637427 21623 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:21.639155 21623 catalog_manager.cc:1347] Generated new cluster ID: af46d0b2bb1046fd9e705f720e7af285
I20260812 00:04:21.639207 21623 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:04:21 dist-test-slave-vpvm krb5kdc[21451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493061, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:04:21.645030 21594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:21.631084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46572 (local address 127.25.103.126:45891)
0812 00:04:21.631411 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:21.631423 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:21.631460 (+ 37us) server_negotiation.cc:407] Connection header received
0812 00:04:21.632355 (+ 895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:21.632366 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:21.632441 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:21.632625 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:21.633658 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:21.635077 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:21.636152 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:21.636813 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:21.636929 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:21.640029 (+ 3100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:21.640033 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:21.640034 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:21.640048 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:21.642287 (+ 2239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:21.642783 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:21.642787 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:21.642788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:21.642941 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:21.643187 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:21.643188 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:21.643189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:21.643595 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:21.643776 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:21.644468 (+ 692us) server_negotiation.cc:299] Negotiation successful
0812 00:04:21.644727 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":184,"threads_started":1}
I20260812 00:04:21.657223 21623 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:21.658213 21623 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:21.669116 21623 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a: Generated new TSK 0
I20260812 00:04:21.669329 21623 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
I20260812 00:04:21.701275 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:45891
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:39891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:21.795395 21630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:21.795655 21630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:21.795683 21630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:21.796969 21630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:21.797026 21630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:21.797056 21630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:04:21.799075 21630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:39891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:45891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:21.799547 21630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:21.799886 21630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:21.806290 21641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:21.806290 21643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:21.806401 21640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:21.806981 21630 server_base.cc:1034] running on GCE node
I20260812 00:04:21.807227 21630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:21.807476 21630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:21.808672 21630 hybrid_clock.cc:648] HybridClock initialized: now 1786493061808648 us; error 42 us; skew 500 ppm
Aug 12 00:04:21 dist-test-slave-vpvm krb5kdc[21451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493061, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:21.811394 21630 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:04:21.811885 21630 webserver.cc:460] Webserver started at http://127.25.103.65:34289/ using document root <none> and password file <none>
I20260812 00:04:21.812103 21630 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:21.812146 21630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:21.812270 21630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:21.813391 21630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "a1dd56e45b9a45e6b4833357ce8214ca"
format_stamp: "Formatted at 2026-08-12 00:04:21 on dist-test-slave-vpvm"
server_key: "ca5ccf186dcb1621c02503ec435f86f0"
server_key_iv: "9ca8d6ab69d528d9989fbae083be71ac"
server_key_version: "encryptionkey@0"
I20260812 00:04:21.813752 21630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "a1dd56e45b9a45e6b4833357ce8214ca"
format_stamp: "Formatted at 2026-08-12 00:04:21 on dist-test-slave-vpvm"
server_key: "ca5ccf186dcb1621c02503ec435f86f0"
server_key_iv: "9ca8d6ab69d528d9989fbae083be71ac"
server_key_version: "encryptionkey@0"
I20260812 00:04:21.815312 21630 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:04:21.816282 21653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:21.816530 21630 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:21.816640 21630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "a1dd56e45b9a45e6b4833357ce8214ca"
format_stamp: "Formatted at 2026-08-12 00:04:21 on dist-test-slave-vpvm"
server_key: "ca5ccf186dcb1621c02503ec435f86f0"
server_key_iv: "9ca8d6ab69d528d9989fbae083be71ac"
server_key_version: "encryptionkey@0"
I20260812 00:04:21.816713 21630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:21.827920 21630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:21.830263 21630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:21.830422 21630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:21.830684 21630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:21.831104 21630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:21.831166 21630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:21.831202 21630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:21.831219 21630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:21.837378 21630 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:44331
I20260812 00:04:21.837464 21844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:44331 every 8 connection(s)
I20260812 00:04:21.837785 21630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:04:21.839052 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 21630
I20260812 00:04:21.839169 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:04:21.839365 26013 external_mini_cluster.cc:1428] Setting key e076e53247e13c0bea0f29c66975acda
Aug 12 00:04:21 dist-test-slave-vpvm krb5kdc[21451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493061, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.103.66@KRBTEST.COM; defaulting to no policy
I20260812 00:04:21.848305 21594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:21.838556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:53771 (local address 127.25.103.126:45891)
0812 00:04:21.838611 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:21.838613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:21.838786 (+ 173us) server_negotiation.cc:407] Connection header received
0812 00:04:21.839493 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:21.839495 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:21.839512 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:21.839587 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:21.840981 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:21.841505 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:21.842722 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:21.842944 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:21.843004 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:21.845355 (+ 2351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:21.845357 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:21.845358 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:21.845369 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:21.846939 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:21.847358 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:21.847360 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:21.847360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:21.847417 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:21.847650 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:21.847651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:21.847651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:21.847774 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:21.847833 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:21.848109 (+ 276us) server_negotiation.cc:299] Negotiation successful
0812 00:04:21.848210 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:04:21.848491 21848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:21.838504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:45891 (local address 127.25.103.65:53771)
0812 00:04:21.838666 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:21.838709 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:21.839345 (+ 636us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:21.839672 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:21.839676 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:21.840433 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:21.840854 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:21.840864 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:21.841608 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:21.841609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:21.842629 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:21.842632 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:21.843029 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:21.843030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:21.843182 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:21.843790 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:21.843799 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:21.845252 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:21.847035 (+ 1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:21.847045 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:21.847048 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:21.847286 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:21.847479 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:21.847479 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:21.847480 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:21.847589 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:21.847832 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:21.847839 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:21.847987 (+ 148us) client_negotiation.cc:769] Sending connection context
0812 00:04:21.848080 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 00:04:21.848253 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":67,"threads_started":1}
I20260812 00:04:21.849020 21845 heartbeater.cc:347] Connected to a master server at 127.25.103.126:45891
I20260812 00:04:21.849170 21845 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:21.849372 21845 heartbeater.cc:511] Master 127.25.103.126:45891 requested a full tablet report, sending...
I20260812 00:04:21.850148 21526 ts_manager.cc:194] Registered new tserver with Master: a1dd56e45b9a45e6b4833357ce8214ca (127.25.103.65:44331)
I20260812 00:04:21.850773 21526 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:53771
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
I20260812 00:04:21.869001 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:45891
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:39891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:21.963801 21854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:21.964051 21854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:21.964076 21854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:21.965313 21854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:21.965366 21854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:21.965396 21854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:04:21.967043 21854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:39891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:45891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:21.967310 21854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:21.967561 21854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:21.973181 21861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:21.973206 21860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:21.973214 21854 server_base.cc:1034] running on GCE node
W20260812 00:04:21.973181 21863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:21.973636 21854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:21.973919 21854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:21.975116 21854 hybrid_clock.cc:648] HybridClock initialized: now 1786493061975104 us; error 34 us; skew 500 ppm
Aug 12 00:04:21 dist-test-slave-vpvm krb5kdc[21451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493061, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:21.978101 21854 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:04:21.978636 21854 webserver.cc:460] Webserver started at http://127.25.103.66:40055/ using document root <none> and password file <none>
I20260812 00:04:21.978858 21854 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:21.978912 21854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:21.979049 21854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:21.980156 21854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "f2917b249efc445eab5226cca03bab7a"
format_stamp: "Formatted at 2026-08-12 00:04:21 on dist-test-slave-vpvm"
server_key: "63703fe3aa8c3806e901615d9eb50a1f"
server_key_iv: "8485134c5d97ddadcaa68b708e76c967"
server_key_version: "encryptionkey@0"
I20260812 00:04:21.980520 21854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "f2917b249efc445eab5226cca03bab7a"
format_stamp: "Formatted at 2026-08-12 00:04:21 on dist-test-slave-vpvm"
server_key: "63703fe3aa8c3806e901615d9eb50a1f"
server_key_iv: "8485134c5d97ddadcaa68b708e76c967"
server_key_version: "encryptionkey@0"
I20260812 00:04:21.982170 21854 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:04:21.983155 21875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:21.983544 21854 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:21.983667 21854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "f2917b249efc445eab5226cca03bab7a"
format_stamp: "Formatted at 2026-08-12 00:04:21 on dist-test-slave-vpvm"
server_key: "63703fe3aa8c3806e901615d9eb50a1f"
server_key_iv: "8485134c5d97ddadcaa68b708e76c967"
server_key_version: "encryptionkey@0"
I20260812 00:04:21.983750 21854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:22.001922 21854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:22.005033 21854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:22.005214 21854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:22.005478 21854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:22.005813 21854 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:22.005849 21854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:22.005880 21854 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:22.005903 21854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:22.012864 21854 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:46641
I20260812 00:04:22.012933 22074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:46641 every 8 connection(s)
I20260812 00:04:22.013325 21854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:04:22.019325 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 21854
I20260812 00:04:22.019435 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:04:22.019630 26013 external_mini_cluster.cc:1428] Setting key 495a15c980a6122cc32b4b77b49f2035
Aug 12 00:04:22 dist-test-slave-vpvm krb5kdc[21451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493061, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:04:22.024698 21594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.014202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:49095 (local address 127.25.103.126:45891)
0812 00:04:22.014269 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:22.014271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:22.014510 (+ 239us) server_negotiation.cc:407] Connection header received
0812 00:04:22.015069 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:22.015071 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:22.015084 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:22.015134 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:22.016193 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.016721 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.017767 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.018022 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.018079 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.021556 (+ 3477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:22.021558 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:22.021559 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:22.021570 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:22.023196 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:22.023698 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:22.023700 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:22.023700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:22.023772 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:22.024011 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:22.024012 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:22.024012 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:22.024138 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:22.024197 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:22.024488 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 00:04:22.024598 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:04:22.024891 22078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.014177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:45891 (local address 127.25.103.66:49095)
0812 00:04:22.014374 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:22.014420 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:22.014960 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:22.015222 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:22.015225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:22.015853 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:22.016085 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:22.016090 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.016816 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.016817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:22.017674 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:22.017677 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.018110 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.018112 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:22.018238 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.018862 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:22.018876 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:22.021396 (+ 2520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:22.023305 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:22.023321 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:22.023325 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:22.023620 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:22.023835 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:22.023836 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:22.023836 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:22.023953 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:22.024197 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:22.024204 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:22.024362 (+ 158us) client_negotiation.cc:769] Sending connection context
0812 00:04:22.024460 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 00:04:22.024651 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":96,"threads_started":1}
I20260812 00:04:22.025431 22076 heartbeater.cc:347] Connected to a master server at 127.25.103.126:45891
I20260812 00:04:22.025533 22076 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:22.025727 22076 heartbeater.cc:511] Master 127.25.103.126:45891 requested a full tablet report, sending...
I20260812 00:04:22.026165 21526 ts_manager.cc:194] Registered new tserver with Master: f2917b249efc445eab5226cca03bab7a (127.25.103.66:46641)
I20260812 00:04:22.026710 21526 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:49095
WARNING: no policy specified for kudu/127.25.103.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
I20260812 00:04:22.049574 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:45891
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:39891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:22.140589 22085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:22.140829 22085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:22.140856 22085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:22.142066 22085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:22.142115 22085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:22.142145 22085 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:04:22.143675 22085 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:39891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:45891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:22.143887 22085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:22.144106 22085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:22.149169 22100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:22.149139 22093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:22.149369 22085 server_base.cc:1034] running on GCE node
W20260812 00:04:22.149366 22095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:22.149616 22085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:22.149863 22085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:22.151027 22085 hybrid_clock.cc:648] HybridClock initialized: now 1786493062151006 us; error 34 us; skew 500 ppm
Aug 12 00:04:22 dist-test-slave-vpvm krb5kdc[21451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493062, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:22.153600 22085 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:04:22.154048 22085 webserver.cc:460] Webserver started at http://127.25.103.67:37357/ using document root <none> and password file <none>
I20260812 00:04:22.154239 22085 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:22.154278 22085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:22.154374 22085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:22.155390 22085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "74ced973679b42e0b08ae21f3bfaec7b"
format_stamp: "Formatted at 2026-08-12 00:04:22 on dist-test-slave-vpvm"
server_key: "c81e78259676f29b943d32f177fe4866"
server_key_iv: "df99ac4c72382ffbf85498c8ef21f32c"
server_key_version: "encryptionkey@0"
I20260812 00:04:22.155699 22085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "74ced973679b42e0b08ae21f3bfaec7b"
format_stamp: "Formatted at 2026-08-12 00:04:22 on dist-test-slave-vpvm"
server_key: "c81e78259676f29b943d32f177fe4866"
server_key_iv: "df99ac4c72382ffbf85498c8ef21f32c"
server_key_version: "encryptionkey@0"
I20260812 00:04:22.157044 22085 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:04:22.158013 22112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:22.158190 22085 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:22.158285 22085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "74ced973679b42e0b08ae21f3bfaec7b"
format_stamp: "Formatted at 2026-08-12 00:04:22 on dist-test-slave-vpvm"
server_key: "c81e78259676f29b943d32f177fe4866"
server_key_iv: "df99ac4c72382ffbf85498c8ef21f32c"
server_key_version: "encryptionkey@0"
I20260812 00:04:22.158345 22085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:22.170404 22085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:22.172557 22085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:22.172677 22085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:22.172863 22085 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:22.173211 22085 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:22.173249 22085 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:22.173273 22085 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:22.173285 22085 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:22.179776 22085 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:38721
I20260812 00:04:22.179843 22305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:38721 every 8 connection(s)
I20260812 00:04:22.180156 22085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:04:22.186908 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 22085
I20260812 00:04:22.187027 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:04:22.187217 26013 external_mini_cluster.cc:1428] Setting key e234520fbc5cd8b1be1718db5dd4624c
Aug 12 00:04:22 dist-test-slave-vpvm krb5kdc[21451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493062, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:04:22.191625 21594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.180916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:59729 (local address 127.25.103.126:45891)
0812 00:04:22.180973 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:22.180976 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:22.181148 (+ 172us) server_negotiation.cc:407] Connection header received
0812 00:04:22.181732 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:22.181735 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:22.181754 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:22.181853 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:22.182976 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.183547 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.184624 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.184834 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.184900 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.187999 (+ 3099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:22.188001 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:22.188002 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:22.188013 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:22.189761 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:22.190317 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:22.190318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:22.190318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:22.190386 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:22.190805 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:22.190806 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:22.190806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:22.190943 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:22.191002 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:22.191456 (+ 454us) server_negotiation.cc:299] Negotiation successful
0812 00:04:22.191550 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:04:22.191854 22309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.180852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:45891 (local address 127.25.103.67:59729)
0812 00:04:22.181024 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:22.181078 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:22.181571 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:22.181930 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:22.181934 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:22.182607 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:22.182828 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:22.182834 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.183662 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.183663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:22.184507 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:22.184510 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.184938 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.184939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:22.185060 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.185663 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:22.185680 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:22.187870 (+ 2190us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:22.189858 (+ 1988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:22.189868 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:22.189870 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:22.190225 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:22.190505 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:22.190507 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:22.190507 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:22.190695 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:22.191047 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:22.191056 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:22.191224 (+ 168us) client_negotiation.cc:769] Sending connection context
0812 00:04:22.191327 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 00:04:22.191586 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":88,"threads_started":1}
I20260812 00:04:22.192340 22307 heartbeater.cc:347] Connected to a master server at 127.25.103.126:45891
I20260812 00:04:22.192444 22307 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:22.192673 22307 heartbeater.cc:511] Master 127.25.103.126:45891 requested a full tablet report, sending...
I20260812 00:04:22.193076 21526 ts_manager.cc:194] Registered new tserver with Master: 74ced973679b42e0b08ae21f3bfaec7b (127.25.103.67:38721)
I20260812 00:04:22.193447 21526 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:59729
I20260812 00:04:22.199648 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:04:22.208046 21594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.201201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46588 (local address 127.25.103.126:45891)
0812 00:04:22.201249 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:22.201252 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:22.201334 (+ 82us) server_negotiation.cc:407] Connection header received
0812 00:04:22.201492 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:22.201493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:22.201510 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:22.201600 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:22.202298 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.202860 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.203649 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.203901 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.203984 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.205274 (+ 1290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:22.205276 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:22.205277 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:22.205286 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:22.206627 (+ 1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:22.206958 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:22.206958 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:22.206958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:22.207005 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:22.207354 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:22.207355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:22.207356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:22.207587 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:22.207681 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:22.207888 (+ 207us) server_negotiation.cc:299] Negotiation successful
0812 00:04:22.207970 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:04:22.210237 21526 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46588:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:04:22.212147 21526 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:04:22.220130 22324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.215304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:44331 (local address 127.0.0.1:44738)
0812 00:04:22.215494 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:22.215536 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:22.215609 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:22.215923 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:22.215926 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:22.215929 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:22.216015 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:22.216018 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.217455 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.217456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:22.218605 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:22.218608 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.219763 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.219764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:22.219864 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.219884 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 00:04:22.219958 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 00:04:22.220025 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":81,"thread_start_us":51,"threads_started":1}
I20260812 00:04:22.220353 22332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.215583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39504 (local address 127.25.103.66:46641)
0812 00:04:22.216335 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:22.216340 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:22.216348 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:04:22.216386 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:22.216388 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:22.216402 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:22.216484 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:22.216779 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.217822 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.219185 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.219814 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.219881 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.219937 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:22.220173 (+ 236us) server_negotiation.cc:299] Negotiation successful
0812 00:04:22.220275 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":720,"thread_start_us":94,"threads_started":1}
I20260812 00:04:22.220141 22329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.215432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44738 (local address 127.25.103.65:44331)
0812 00:04:22.215773 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:22.215778 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:22.215787 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:04:22.215820 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:22.215822 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:22.215834 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:22.215894 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:22.216087 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.217185 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.218695 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.219679 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.219761 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.219831 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:22.219986 (+ 155us) server_negotiation.cc:299] Negotiation successful
0812 00:04:22.220049 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":105,"threads_started":1}
I20260812 00:04:22.220525 22328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.215433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59760 (local address 127.25.103.67:38721)
0812 00:04:22.215770 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:22.215775 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:22.216117 (+ 342us) server_negotiation.cc:407] Connection header received
0812 00:04:22.216160 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:22.216162 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:22.216176 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:22.216235 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:22.216374 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.217394 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.218931 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.219939 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.220005 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.220066 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:22.220392 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 00:04:22.220444 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":98,"threads_started":1}
I20260812 00:04:22.220320 22330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.215304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:38721 (local address 127.0.0.1:59760)
0812 00:04:22.215995 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:22.216004 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:22.216051 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:22.216250 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:22.216251 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:22.216253 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:22.216293 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:22.216294 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.217517 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.217518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:22.218829 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:22.218833 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.220102 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.220103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:22.220161 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.220166 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:04:22.220213 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 00:04:22.220254 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":672,"mutex_wait_us":295,"thread_start_us":99,"threads_started":1}
I20260812 00:04:22.220484 22323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.215305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:46641 (local address 127.0.0.1:39504)
0812 00:04:22.215628 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:22.215638 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:22.215681 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:22.216568 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:22.216570 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:22.216575 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:22.216672 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:22.216674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.217938 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.217939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:22.219073 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:22.219075 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.219974 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.219975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:22.220032 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.220036 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:04:22.220080 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:04:22.220115 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"mutex_wait_us":2,"thread_start_us":118,"threads_started":1}
I20260812 00:04:22.221439 22181 tablet_service.cc:1467] Processing CreateTablet for tablet a7df6c4f0b69418a98da29103cb03f2f (DEFAULT_TABLE table=test-table [id=6da4bfd196724db88b662991c3d3d013]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:22.221459 21967 tablet_service.cc:1467] Processing CreateTablet for tablet a7df6c4f0b69418a98da29103cb03f2f (DEFAULT_TABLE table=test-table [id=6da4bfd196724db88b662991c3d3d013]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:22.221812 22181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7df6c4f0b69418a98da29103cb03f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:22.222103 21967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7df6c4f0b69418a98da29103cb03f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:22.221846 21734 tablet_service.cc:1467] Processing CreateTablet for tablet a7df6c4f0b69418a98da29103cb03f2f (DEFAULT_TABLE table=test-table [id=6da4bfd196724db88b662991c3d3d013]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:22.222400 21734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7df6c4f0b69418a98da29103cb03f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:22.224629 22333 tablet_bootstrap.cc:492] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b: Bootstrap starting.
I20260812 00:04:22.225297 22333 tablet_bootstrap.cc:654] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:22.225767 22333 log.cc:824] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:22.226135 22335 tablet_bootstrap.cc:492] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a: Bootstrap starting.
I20260812 00:04:22.226539 22338 tablet_bootstrap.cc:492] T a7df6c4f0b69418a98da29103cb03f2f P a1dd56e45b9a45e6b4833357ce8214ca: Bootstrap starting.
I20260812 00:04:22.226768 22333 tablet_bootstrap.cc:492] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b: No bootstrap required, opened a new log
I20260812 00:04:22.226840 22333 ts_tablet_manager.cc:1397] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:04:22.226922 22335 tablet_bootstrap.cc:654] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:22.227293 22338 tablet_bootstrap.cc:654] T a7df6c4f0b69418a98da29103cb03f2f P a1dd56e45b9a45e6b4833357ce8214ca: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:22.227456 22335 log.cc:824] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:22.227828 22338 log.cc:824] T a7df6c4f0b69418a98da29103cb03f2f P a1dd56e45b9a45e6b4833357ce8214ca: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:22.228269 22335 tablet_bootstrap.cc:492] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a: No bootstrap required, opened a new log
I20260812 00:04:22.228315 22335 ts_tablet_manager.cc:1397] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:04:22.228411 22333 raft_consensus.cc:348] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2917b249efc445eab5226cca03bab7a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46641 } } peers { permanent_uuid: "74ced973679b42e0b08ae21f3bfaec7b" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38721 } } peers { permanent_uuid: "a1dd56e45b9a45e6b4833357ce8214ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 44331 } }
I20260812 00:04:22.228582 22333 raft_consensus.cc:374] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:22.228616 22333 raft_consensus.cc:729] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ced973679b42e0b08ae21f3bfaec7b, State: Initialized, Role: FOLLOWER
I20260812 00:04:22.228724 22333 consensus_queue.cc:260] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2917b249efc445eab5226cca03bab7a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46641 } } peers { permanent_uuid: "74ced973679b42e0b08ae21f3bfaec7b" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38721 } } peers { permanent_uuid: "a1dd56e45b9a45e6b4833357ce8214ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 44331 } }
I20260812 00:04:22.228981 22333 ts_tablet_manager.cc:1428] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:04:22.229054 22307 heartbeater.cc:503] Master 127.25.103.126:45891 was elected leader, sending a full tablet report...
I20260812 00:04:22.230293 22335 raft_consensus.cc:348] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2917b249efc445eab5226cca03bab7a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46641 } } peers { permanent_uuid: "74ced973679b42e0b08ae21f3bfaec7b" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38721 } } peers { permanent_uuid: "a1dd56e45b9a45e6b4833357ce8214ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 44331 } }
I20260812 00:04:22.230458 22335 raft_consensus.cc:374] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:22.230480 22335 raft_consensus.cc:729] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2917b249efc445eab5226cca03bab7a, State: Initialized, Role: FOLLOWER
I20260812 00:04:22.230597 22335 consensus_queue.cc:260] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2917b249efc445eab5226cca03bab7a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46641 } } peers { permanent_uuid: "74ced973679b42e0b08ae21f3bfaec7b" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38721 } } peers { permanent_uuid: "a1dd56e45b9a45e6b4833357ce8214ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 44331 } }
I20260812 00:04:22.230871 22335 ts_tablet_manager.cc:1428] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:04:22.230918 22076 heartbeater.cc:503] Master 127.25.103.126:45891 was elected leader, sending a full tablet report...
I20260812 00:04:22.231549 22338 tablet_bootstrap.cc:492] T a7df6c4f0b69418a98da29103cb03f2f P a1dd56e45b9a45e6b4833357ce8214ca: No bootstrap required, opened a new log
I20260812 00:04:22.231629 22338 ts_tablet_manager.cc:1397] T a7df6c4f0b69418a98da29103cb03f2f P a1dd56e45b9a45e6b4833357ce8214ca: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260812 00:04:22.233111 22338 raft_consensus.cc:348] T a7df6c4f0b69418a98da29103cb03f2f P a1dd56e45b9a45e6b4833357ce8214ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2917b249efc445eab5226cca03bab7a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46641 } } peers { permanent_uuid: "74ced973679b42e0b08ae21f3bfaec7b" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38721 } } peers { permanent_uuid: "a1dd56e45b9a45e6b4833357ce8214ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 44331 } }
I20260812 00:04:22.233268 22338 raft_consensus.cc:374] T a7df6c4f0b69418a98da29103cb03f2f P a1dd56e45b9a45e6b4833357ce8214ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:22.233291 22338 raft_consensus.cc:729] T a7df6c4f0b69418a98da29103cb03f2f P a1dd56e45b9a45e6b4833357ce8214ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1dd56e45b9a45e6b4833357ce8214ca, State: Initialized, Role: FOLLOWER
I20260812 00:04:22.233398 22338 consensus_queue.cc:260] T a7df6c4f0b69418a98da29103cb03f2f P a1dd56e45b9a45e6b4833357ce8214ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2917b249efc445eab5226cca03bab7a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46641 } } peers { permanent_uuid: "74ced973679b42e0b08ae21f3bfaec7b" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38721 } } peers { permanent_uuid: "a1dd56e45b9a45e6b4833357ce8214ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 44331 } }
I20260812 00:04:22.233680 22338 ts_tablet_manager.cc:1428] T a7df6c4f0b69418a98da29103cb03f2f P a1dd56e45b9a45e6b4833357ce8214ca: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:04:22.233748 21845 heartbeater.cc:503] Master 127.25.103.126:45891 was elected leader, sending a full tablet report...
I20260812 00:04:22.261031 22342 raft_consensus.cc:482] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:22.261222 22342 raft_consensus.cc:504] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2917b249efc445eab5226cca03bab7a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46641 } } peers { permanent_uuid: "74ced973679b42e0b08ae21f3bfaec7b" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38721 } } peers { permanent_uuid: "a1dd56e45b9a45e6b4833357ce8214ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 44331 } }
I20260812 00:04:22.261655 22342 leader_election.cc:288] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ced973679b42e0b08ae21f3bfaec7b (127.25.103.67:38721), a1dd56e45b9a45e6b4833357ce8214ca (127.25.103.65:44331)
W20260812 00:04:22.264137 22077 tablet.cc:2369] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:04:22.265345 22328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.262351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:47921 (local address 127.25.103.67:38721)
0812 00:04:22.262416 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:22.262419 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:22.262429 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:04:22.262456 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:22.262457 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:22.262466 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:22.262521 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:22.262733 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.263426 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.264608 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.265015 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.265084 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.265094 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:22.265237 (+ 143us) server_negotiation.cc:299] Negotiation successful
0812 00:04:22.265278 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:04:22.265357 22078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.261856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:38721 (local address 127.25.103.66:47921)
0812 00:04:22.261901 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:22.261914 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:22.262103 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:22.262548 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:22.262550 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:22.262552 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:22.262644 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:22.262647 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.263501 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.263503 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:22.264512 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:22.264516 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.265091 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.265092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:22.265172 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.265176 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:04:22.265222 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 00:04:22.265269 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23,"mutex_wait_us":23}
I20260812 00:04:22.265376 22345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.261869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:44331 (local address 127.25.103.66:35203)
0812 00:04:22.262194 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:22.262204 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:22.262275 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:22.262441 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:22.262442 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:22.262446 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:22.262556 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:22.262558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.263615 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.263617 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:22.264506 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:22.264510 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.265128 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.265129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:22.265190 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.265193 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:04:22.265237 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:04:22.265279 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":1,"thread_start_us":266,"threads_started":1}
I20260812 00:04:22.265358 22329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.261929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:35203 (local address 127.25.103.65:44331)
0812 00:04:22.262006 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:22.262008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:22.262275 (+ 267us) server_negotiation.cc:407] Connection header received
0812 00:04:22.262338 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:22.262340 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:22.262349 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:22.262405 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:22.262705 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.263512 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.264608 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.265051 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.265118 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.265128 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:22.265249 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 00:04:22.265290 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 00:04:22.265738 21767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7df6c4f0b69418a98da29103cb03f2f" candidate_uuid: "f2917b249efc445eab5226cca03bab7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1dd56e45b9a45e6b4833357ce8214ca" is_pre_election: true
I20260812 00:04:22.265894 21767 raft_consensus.cc:2454] T a7df6c4f0b69418a98da29103cb03f2f P a1dd56e45b9a45e6b4833357ce8214ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2917b249efc445eab5226cca03bab7a in term 0.
I20260812 00:04:22.266052 22225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7df6c4f0b69418a98da29103cb03f2f" candidate_uuid: "f2917b249efc445eab5226cca03bab7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ced973679b42e0b08ae21f3bfaec7b" is_pre_election: true
I20260812 00:04:22.266191 22225 raft_consensus.cc:2454] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2917b249efc445eab5226cca03bab7a in term 0.
I20260812 00:04:22.266166 21880 leader_election.cc:302] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1dd56e45b9a45e6b4833357ce8214ca, f2917b249efc445eab5226cca03bab7a; no voters:
I20260812 00:04:22.266315 22342 raft_consensus.cc:2781] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:04:22.266363 22342 raft_consensus.cc:482] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:04:22.266386 22342 raft_consensus.cc:3037] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:22.267292 22342 raft_consensus.cc:504] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2917b249efc445eab5226cca03bab7a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46641 } } peers { permanent_uuid: "74ced973679b42e0b08ae21f3bfaec7b" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38721 } } peers { permanent_uuid: "a1dd56e45b9a45e6b4833357ce8214ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 44331 } }
I20260812 00:04:22.267452 22342 leader_election.cc:288] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [CANDIDATE]: Term 1 election: Requested vote from peers 74ced973679b42e0b08ae21f3bfaec7b (127.25.103.67:38721), a1dd56e45b9a45e6b4833357ce8214ca (127.25.103.65:44331)
I20260812 00:04:22.267620 21767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7df6c4f0b69418a98da29103cb03f2f" candidate_uuid: "f2917b249efc445eab5226cca03bab7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1dd56e45b9a45e6b4833357ce8214ca"
I20260812 00:04:22.267652 22225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7df6c4f0b69418a98da29103cb03f2f" candidate_uuid: "f2917b249efc445eab5226cca03bab7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ced973679b42e0b08ae21f3bfaec7b"
I20260812 00:04:22.267726 22225 raft_consensus.cc:3037] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:22.267709 21767 raft_consensus.cc:3037] T a7df6c4f0b69418a98da29103cb03f2f P a1dd56e45b9a45e6b4833357ce8214ca [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:22.268458 22225 raft_consensus.cc:2454] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2917b249efc445eab5226cca03bab7a in term 1.
I20260812 00:04:22.268463 21767 raft_consensus.cc:2454] T a7df6c4f0b69418a98da29103cb03f2f P a1dd56e45b9a45e6b4833357ce8214ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2917b249efc445eab5226cca03bab7a in term 1.
I20260812 00:04:22.268632 21880 leader_election.cc:302] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1dd56e45b9a45e6b4833357ce8214ca, f2917b249efc445eab5226cca03bab7a; no voters:
I20260812 00:04:22.268725 22342 raft_consensus.cc:2781] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:22.268918 22342 raft_consensus.cc:686] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [term 1 LEADER]: Becoming Leader. State: Replica: f2917b249efc445eab5226cca03bab7a, State: Running, Role: LEADER
I20260812 00:04:22.269048 22342 consensus_queue.cc:237] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2917b249efc445eab5226cca03bab7a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46641 } } peers { permanent_uuid: "74ced973679b42e0b08ae21f3bfaec7b" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38721 } } peers { permanent_uuid: "a1dd56e45b9a45e6b4833357ce8214ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 44331 } }
I20260812 00:04:22.269992 21526 catalog_manager.cc:5495] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a reported cstate change: term changed from 0 to 1, leader changed from <none> to f2917b249efc445eab5226cca03bab7a (127.25.103.66). New cstate: current_term: 1 leader_uuid: "f2917b249efc445eab5226cca03bab7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2917b249efc445eab5226cca03bab7a" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 46641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ced973679b42e0b08ae21f3bfaec7b" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1dd56e45b9a45e6b4833357ce8214ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 44331 } health_report { overall_health: UNKNOWN } } }
I20260812 00:04:22.280515 22332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.278127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39516 (local address 127.25.103.66:46641)
0812 00:04:22.278180 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:22.278182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:22.278192 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:04:22.278265 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:22.278266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:22.278285 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:22.278343 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:04:22.278472 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.278955 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.279709 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.279897 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.279960 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.280094 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:04:22.280203 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:04:22.280277 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:22.280297 (+ 20us) server_negotiation.cc:299] Negotiation successful
0812 00:04:22.280322 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:04:22.282900 21767 raft_consensus.cc:1261] T a7df6c4f0b69418a98da29103cb03f2f P a1dd56e45b9a45e6b4833357ce8214ca [term 1 FOLLOWER]: Refusing update from remote peer f2917b249efc445eab5226cca03bab7a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:22.283044 22225 raft_consensus.cc:1261] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b [term 1 FOLLOWER]: Refusing update from remote peer f2917b249efc445eab5226cca03bab7a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:22.283283 22346 consensus_queue.cc:1035] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1dd56e45b9a45e6b4833357ce8214ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 44331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:22.283584 22346 consensus_queue.cc:1035] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ced973679b42e0b08ae21f3bfaec7b" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:22.286710 22352 mvcc.cc:205] Tried to move back new op lower bound from 7317475583107936256 to 7317475583054659584. Current Snapshot: MvccSnapshot[applied={T|T < 7317475583107936256 or (T in {7317475583107936256})}]
I20260812 00:04:22.288376 21526 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46588:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:22.288501 21526 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46588:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:22.288589 22355 mvcc.cc:205] Tried to move back new op lower bound from 7317475583107936256 to 7317475583054659584. Current Snapshot: MvccSnapshot[applied={T|T < 7317475583107936256}]
I20260812 00:04:22.289227 21526 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a0619f180c44be0a8aeb12e480c2a9a: Sending DeleteTablet for 3 replicas of tablet a7df6c4f0b69418a98da29103cb03f2f
I20260812 00:04:22.289637 22181 tablet_service.cc:1514] Processing DeleteTablet for tablet a7df6c4f0b69418a98da29103cb03f2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:22 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:59760
I20260812 00:04:22.289738 21967 tablet_service.cc:1514] Processing DeleteTablet for tablet a7df6c4f0b69418a98da29103cb03f2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:22 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:39504
I20260812 00:04:22.289816 21734 tablet_service.cc:1514] Processing DeleteTablet for tablet a7df6c4f0b69418a98da29103cb03f2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:22 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:44738
I20260812 00:04:22.290218 22365 tablet_replica.cc:330] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b: stopping tablet replica
I20260812 00:04:22.290207 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 21630
I20260812 00:04:22.293892 22365 raft_consensus.cc:2229] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:04:22.294178 22365 raft_consensus.cc:2258] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:22.294500 22367 tablet_replica.cc:330] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a: stopping tablet replica
I20260812 00:04:22.294869 22367 raft_consensus.cc:2229] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:04:22.295203 22367 raft_consensus.cc:2258] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:22.297767 22367 ts_tablet_manager.cc:1905] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:04:22.302258 22367 ts_tablet_manager.cc:1918] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:22.302479 22367 log.cc:1196] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/a7df6c4f0b69418a98da29103cb03f2f
I20260812 00:04:22.303232 22367 ts_tablet_manager.cc:1939] T a7df6c4f0b69418a98da29103cb03f2f P f2917b249efc445eab5226cca03bab7a: Deleting consensus metadata
I20260812 00:04:22.308835 21506 catalog_manager.cc:4841] TS f2917b249efc445eab5226cca03bab7a (127.25.103.66:46641): tablet a7df6c4f0b69418a98da29103cb03f2f (table test-table [id=6da4bfd196724db88b662991c3d3d013]) successfully deleted
I20260812 00:04:22.309173 22365 ts_tablet_manager.cc:1905] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:04:22.311311 22365 ts_tablet_manager.cc:1918] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:22.311414 22365 log.cc:1196] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/a7df6c4f0b69418a98da29103cb03f2f
I20260812 00:04:22.311746 22365 ts_tablet_manager.cc:1939] T a7df6c4f0b69418a98da29103cb03f2f P 74ced973679b42e0b08ae21f3bfaec7b: Deleting consensus metadata
I20260812 00:04:22.312260 21501 catalog_manager.cc:4841] TS 74ced973679b42e0b08ae21f3bfaec7b (127.25.103.67:38721): tablet a7df6c4f0b69418a98da29103cb03f2f (table test-table [id=6da4bfd196724db88b662991c3d3d013]) successfully deleted
W20260812 00:04:22.320956 21502 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.103.65:44331 (error 108)
I20260812 00:04:22.321195 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 21854
I20260812 00:04:22.351506 22323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.349542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:44331 (local address 127.0.0.1:44740)
0812 00:04:22.351363 (+ 1821us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:22.351445 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:44331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1785}
W20260812 00:04:22.352084 21502 catalog_manager.cc:4584] TS a1dd56e45b9a45e6b4833357ce8214ca (127.25.103.65:44331): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a7df6c4f0b69418a98da29103cb03f2f: Network error: Client connection negotiation failed: client connection to 127.25.103.65:44331: connect: Connection refused (error 111)
I20260812 00:04:22.356284 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 22085
I20260812 00:04:22.372932 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 21471
2026-08-12T00:04:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2278 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T00:04:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:22Z Disabled control of system clock
I20260812 00:04:22.419560 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:33149
--webserver_interface=127.25.103.126
--webserver_port=0
--builtin_ntp_servers=127.25.103.84:45279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:33149
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:04:22.514173 22376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:22.514436 22376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:22.514467 22376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:22.515748 22376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:22.515803 22376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:22.515820 22376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:22.515837 22376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:22.515853 22376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:22.517400 22376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:45279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:33149
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:33149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:22.517704 22376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:22.518056 22376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:22.523156 22389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:22.523303 22386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:22.523303 22387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:22.523373 22376 server_base.cc:1034] running on GCE node
I20260812 00:04:22.523836 22376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:22.524173 22376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:22.525357 22376 hybrid_clock.cc:648] HybridClock initialized: now 1786493062525317 us; error 67 us; skew 500 ppm
I20260812 00:04:22.527062 22376 webserver.cc:460] Webserver started at http://127.25.103.126:36009/ using document root <none> and password file <none>
I20260812 00:04:22.527348 22376 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:22.527407 22376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:22.527556 22376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:22.528726 22376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "9afcb9f2e0cc4cd6af91d2c1de627d56"
format_stamp: "Formatted at 2026-08-12 00:04:22 on dist-test-slave-vpvm"
server_key: "c5cd647c023dd4150e1aa37d03524d19"
server_key_iv: "a8f1306e7bd22471b4c7c5ad504d5995"
server_key_version: "encryptionkey@0"
I20260812 00:04:22.529098 22376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "9afcb9f2e0cc4cd6af91d2c1de627d56"
format_stamp: "Formatted at 2026-08-12 00:04:22 on dist-test-slave-vpvm"
server_key: "c5cd647c023dd4150e1aa37d03524d19"
server_key_iv: "a8f1306e7bd22471b4c7c5ad504d5995"
server_key_version: "encryptionkey@0"
I20260812 00:04:22.531212 22376 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20260812 00:04:22.532368 22403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:22.532711 22376 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:22.532836 22376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "9afcb9f2e0cc4cd6af91d2c1de627d56"
format_stamp: "Formatted at 2026-08-12 00:04:22 on dist-test-slave-vpvm"
server_key: "c5cd647c023dd4150e1aa37d03524d19"
server_key_iv: "a8f1306e7bd22471b4c7c5ad504d5995"
server_key_version: "encryptionkey@0"
I20260812 00:04:22.532948 22376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:22.565047 22376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:22.565488 22376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:22.565646 22376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:22.572068 22376 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:33149
I20260812 00:04:22.572147 22490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:33149 every 8 connection(s)
I20260812 00:04:22.572619 22376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:22.574007 22491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:22.577216 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 22376
I20260812 00:04:22.577337 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:22.577562 26013 external_mini_cluster.cc:1428] Setting key efe74e562817fe3f2430895729786733
I20260812 00:04:22.578161 22491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56: Bootstrap starting.
I20260812 00:04:22.578845 22491 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:22.579154 22491 log.cc:824] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:22.580055 22491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56: No bootstrap required, opened a new log
I20260812 00:04:22.582340 22491 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9afcb9f2e0cc4cd6af91d2c1de627d56" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 33149 } }
I20260812 00:04:22.582496 22491 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:22.582541 22491 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9afcb9f2e0cc4cd6af91d2c1de627d56, State: Initialized, Role: FOLLOWER
I20260812 00:04:22.582680 22491 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9afcb9f2e0cc4cd6af91d2c1de627d56" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 33149 } }
I20260812 00:04:22.582764 22491 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:22.582794 22491 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:22.582831 22491 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:22.583683 22491 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9afcb9f2e0cc4cd6af91d2c1de627d56" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 33149 } }
I20260812 00:04:22.583801 22491 leader_election.cc:302] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9afcb9f2e0cc4cd6af91d2c1de627d56; no voters:
I20260812 00:04:22.585184 22491 leader_election.cc:288] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:22.585520 22495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.578250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47886 (local address 127.25.103.126:33149)
0812 00:04:22.578485 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:22.578497 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:22.578534 (+ 37us) server_negotiation.cc:407] Connection header received
0812 00:04:22.579185 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:22.579197 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:22.579295 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:22.579490 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:22.579736 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.581135 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.582709 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.583378 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.583531 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.584615 (+ 1084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:22.584624 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:22.584624 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:22.584933 (+ 309us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:22.584996 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:22.585014 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:22.585088 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:22.585187 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 00:04:22.585290 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":98,"threads_started":1}
I20260812 00:04:22.586305 22500 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:22.587885 22500 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56 [term 1 LEADER]: Becoming Leader. State: Replica: 9afcb9f2e0cc4cd6af91d2c1de627d56, State: Running, Role: LEADER
I20260812 00:04:22.588136 22491 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:22.588083 22500 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9afcb9f2e0cc4cd6af91d2c1de627d56" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 33149 } }
I20260812 00:04:22.588676 22502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9afcb9f2e0cc4cd6af91d2c1de627d56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9afcb9f2e0cc4cd6af91d2c1de627d56" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 33149 } } }
I20260812 00:04:22.588780 22502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:22.589118 22514 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:22.589298 22505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9afcb9f2e0cc4cd6af91d2c1de627d56. Latest consensus state: current_term: 1 leader_uuid: "9afcb9f2e0cc4cd6af91d2c1de627d56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9afcb9f2e0cc4cd6af91d2c1de627d56" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 33149 } } }
I20260812 00:04:22.589428 22505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:22.589757 22514 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:22.591878 22514 catalog_manager.cc:1347] Generated new cluster ID: ad0151ffa9c449198eecb317f3f40e16
I20260812 00:04:22.591948 22514 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:22.616281 22514 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:22.617143 22514 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:22.624672 22514 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56: Generated new TSK 0
I20260812 00:04:22.624873 22514 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:22.633216 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:33149
--builtin_ntp_servers=127.25.103.84:45279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:04:22.725346 22538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:22.725579 22538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:22.725606 22538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:22.726923 22538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:22.726971 22538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:22.727000 22538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:04:22.728441 22538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:45279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:33149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:22.728705 22538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:22.729023 22538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:22.734285 22552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:22.734314 22551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:22.734314 22554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:22.735404 22538 server_base.cc:1034] running on GCE node
I20260812 00:04:22.735669 22538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:22.735940 22538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:22.737155 22538 hybrid_clock.cc:648] HybridClock initialized: now 1786493062737135 us; error 35 us; skew 500 ppm
I20260812 00:04:22.738585 22538 webserver.cc:460] Webserver started at http://127.25.103.65:43147/ using document root <none> and password file <none>
I20260812 00:04:22.738840 22538 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:22.738888 22538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:22.738984 22538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:22.740096 22538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "863185361d4f4d84855ec47322f5c8ca"
format_stamp: "Formatted at 2026-08-12 00:04:22 on dist-test-slave-vpvm"
server_key: "fbfd39b1e1e461cecb2c301d629741a4"
server_key_iv: "6ef2dad286f0dd9f2d8050af42b23c41"
server_key_version: "encryptionkey@0"
I20260812 00:04:22.740427 22538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "863185361d4f4d84855ec47322f5c8ca"
format_stamp: "Formatted at 2026-08-12 00:04:22 on dist-test-slave-vpvm"
server_key: "fbfd39b1e1e461cecb2c301d629741a4"
server_key_iv: "6ef2dad286f0dd9f2d8050af42b23c41"
server_key_version: "encryptionkey@0"
I20260812 00:04:22.741897 22538 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:04:22.742941 22564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:22.743273 22538 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:04:22.743395 22538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "863185361d4f4d84855ec47322f5c8ca"
format_stamp: "Formatted at 2026-08-12 00:04:22 on dist-test-slave-vpvm"
server_key: "fbfd39b1e1e461cecb2c301d629741a4"
server_key_iv: "6ef2dad286f0dd9f2d8050af42b23c41"
server_key_version: "encryptionkey@0"
I20260812 00:04:22.743479 22538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:22.756417 22538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:22.756878 22538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:22.757035 22538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:22.757344 22538 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:22.757761 22538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:22.757797 22538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:22.757834 22538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:22.757851 22538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:22.764966 22538 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:36689
I20260812 00:04:22.765026 22749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:36689 every 8 connection(s)
I20260812 00:04:22.765377 22538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:04:22.770931 22495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.766173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:46637 (local address 127.25.103.126:33149)
0812 00:04:22.766251 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:22.766254 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:22.766488 (+ 234us) server_negotiation.cc:407] Connection header received
0812 00:04:22.766965 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:22.766966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:22.766981 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:22.767041 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:22.767760 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.768285 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.769370 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.769585 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.769655 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.770594 (+ 939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:22.770596 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:22.770597 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:22.770602 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:22.770621 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:22.770625 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:22.770677 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:22.770834 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 00:04:22.770863 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 00:04:22.771127 22752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.766149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:33149 (local address 127.25.103.65:46637)
0812 00:04:22.766342 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:22.766378 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:22.766877 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:22.767121 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:22.767124 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:22.767133 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:22.767664 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:22.767668 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.768410 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.768412 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:22.769268 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:22.769271 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.769701 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.769702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:22.769847 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.770439 (+ 592us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:04:22.770440 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:22.770474 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:04:22.770500 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:22.770714 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:22.770721 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:22.770724 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:04:22.770802 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 00:04:22.770901 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":87,"threads_started":1}
I20260812 00:04:22.771214 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 22538
I20260812 00:04:22.771301 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:04:22.771500 26013 external_mini_cluster.cc:1428] Setting key d1d7139bcbce4be4e1061a3748bd6b8e
I20260812 00:04:22.771859 22750 heartbeater.cc:347] Connected to a master server at 127.25.103.126:33149
I20260812 00:04:22.771967 22750 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:22.772158 22750 heartbeater.cc:511] Master 127.25.103.126:33149 requested a full tablet report, sending...
I20260812 00:04:22.772490 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:33149
--builtin_ntp_servers=127.25.103.84:45279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:04:22.772683 22434 ts_manager.cc:194] Registered new tserver with Master: 863185361d4f4d84855ec47322f5c8ca (127.25.103.65:36689)
I20260812 00:04:22.773296 22434 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.103.65:46637
W20260812 00:04:22.857299 22753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:22.857522 22753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:22.857553 22753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:22.858785 22753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:22.858832 22753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:22.858866 22753 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:04:22.860227 22753 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:45279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:33149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22753
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:22.860469 22753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:22.860796 22753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:22.865880 22764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:22.865865 22760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:22.865885 22761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:22.866123 22753 server_base.cc:1034] running on GCE node
I20260812 00:04:22.866313 22753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:22.866518 22753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:22.867690 22753 hybrid_clock.cc:648] HybridClock initialized: now 1786493062867674 us; error 28 us; skew 500 ppm
I20260812 00:04:22.868932 22753 webserver.cc:460] Webserver started at http://127.25.103.66:42321/ using document root <none> and password file <none>
I20260812 00:04:22.869155 22753 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:22.869202 22753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:22.869331 22753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:22.870460 22753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "19d1badd34e7475a9b8d68a14da3ec8f"
format_stamp: "Formatted at 2026-08-12 00:04:22 on dist-test-slave-vpvm"
server_key: "60a1edd83730d78ad1d5d2a2987ffa2f"
server_key_iv: "a84e6e1b36b46d078be8ffed4b96904f"
server_key_version: "encryptionkey@0"
I20260812 00:04:22.870810 22753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "19d1badd34e7475a9b8d68a14da3ec8f"
format_stamp: "Formatted at 2026-08-12 00:04:22 on dist-test-slave-vpvm"
server_key: "60a1edd83730d78ad1d5d2a2987ffa2f"
server_key_iv: "a84e6e1b36b46d078be8ffed4b96904f"
server_key_version: "encryptionkey@0"
I20260812 00:04:22.872103 22753 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:04:22.872831 22774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:22.873014 22753 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:22.873100 22753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "19d1badd34e7475a9b8d68a14da3ec8f"
format_stamp: "Formatted at 2026-08-12 00:04:22 on dist-test-slave-vpvm"
server_key: "60a1edd83730d78ad1d5d2a2987ffa2f"
server_key_iv: "a84e6e1b36b46d078be8ffed4b96904f"
server_key_version: "encryptionkey@0"
I20260812 00:04:22.873163 22753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:22.886479 22753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:22.886829 22753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:22.886971 22753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:22.887214 22753 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:22.887655 22753 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:22.887708 22753 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:22.887743 22753 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:22.887760 22753 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:22.893744 22753 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:40113
I20260812 00:04:22.893795 22954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:40113 every 8 connection(s)
I20260812 00:04:22.894193 22753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:04:22.898723 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 22753
I20260812 00:04:22.898828 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:04:22.899014 26013 external_mini_cluster.cc:1428] Setting key 4a8bc7f21d1afda0fbfff888b255d005
I20260812 00:04:22.899775 22495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.894932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:60569 (local address 127.25.103.126:33149)
0812 00:04:22.895040 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:22.895042 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:22.895317 (+ 275us) server_negotiation.cc:407] Connection header received
0812 00:04:22.895829 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:22.895830 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:22.895841 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:22.895899 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:22.896589 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.897108 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.898177 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.898375 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.898441 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.899287 (+ 846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:22.899289 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:22.899289 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:22.899294 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:22.899314 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:22.899319 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:22.899374 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:22.899667 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 00:04:22.899697 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 00:04:22.900008 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:33149
--builtin_ntp_servers=127.25.103.84:45279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:04:22.900004 22962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:22.894924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:33149 (local address 127.25.103.66:60569)
0812 00:04:22.895200 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:22.895234 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:22.895730 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:22.895963 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:22.895967 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:22.895975 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:22.896491 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:22.896495 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.897221 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.897222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:22.898084 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:22.898087 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:22.898449 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:22.898449 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:22.898555 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:22.899138 (+ 583us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:04:22.899138 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:22.899168 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:04:22.899199 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:22.899581 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:22.899588 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:22.899591 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:04:22.899662 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 00:04:22.899779 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":176,"threads_started":1}
I20260812 00:04:22.900427 22955 heartbeater.cc:347] Connected to a master server at 127.25.103.126:33149
I20260812 00:04:22.900518 22955 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:22.900701 22955 heartbeater.cc:511] Master 127.25.103.126:33149 requested a full tablet report, sending...
I20260812 00:04:22.901046 22434 ts_manager.cc:194] Registered new tserver with Master: 19d1badd34e7475a9b8d68a14da3ec8f (127.25.103.66:40113)
I20260812 00:04:22.901409 22434 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.103.66:60569
W20260812 00:04:22.982443 22963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:22.982681 22963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:22.982715 22963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:22.983964 22963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:22.984012 22963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:22.984050 22963 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:04:22.985510 22963 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:45279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:33149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22963
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:22.985777 22963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:22.986119 22963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:22.991328 22970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:22.991370 22973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:22.991336 22971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:22.991570 22963 server_base.cc:1034] running on GCE node
I20260812 00:04:22.991768 22963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:22.992029 22963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:22.993188 22963 hybrid_clock.cc:648] HybridClock initialized: now 1786493062993172 us; error 31 us; skew 500 ppm
I20260812 00:04:22.994482 22963 webserver.cc:460] Webserver started at http://127.25.103.67:35121/ using document root <none> and password file <none>
I20260812 00:04:22.994735 22963 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:22.994791 22963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:22.994925 22963 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:22.996148 22963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "b3875cb9ad4b4e7493c644c0a5005f96"
format_stamp: "Formatted at 2026-08-12 00:04:22 on dist-test-slave-vpvm"
server_key: "cbee03c121e8df89321562da1980affc"
server_key_iv: "11a0a27aac45594f739696d5912e2040"
server_key_version: "encryptionkey@0"
I20260812 00:04:22.996521 22963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "b3875cb9ad4b4e7493c644c0a5005f96"
format_stamp: "Formatted at 2026-08-12 00:04:22 on dist-test-slave-vpvm"
server_key: "cbee03c121e8df89321562da1980affc"
server_key_iv: "11a0a27aac45594f739696d5912e2040"
server_key_version: "encryptionkey@0"
I20260812 00:04:22.997993 22963 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260812 00:04:22.998909 22983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:22.999114 22963 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:04:22.999209 22963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "b3875cb9ad4b4e7493c644c0a5005f96"
format_stamp: "Formatted at 2026-08-12 00:04:22 on dist-test-slave-vpvm"
server_key: "cbee03c121e8df89321562da1980affc"
server_key_iv: "11a0a27aac45594f739696d5912e2040"
server_key_version: "encryptionkey@0"
I20260812 00:04:22.999361 22963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:23.010670 22963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:23.011004 22963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:23.011149 22963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:23.011389 22963 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:23.011726 22963 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:23.011762 22963 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:23.011793 22963 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:23.011811 22963 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:23.017580 22963 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:33173
I20260812 00:04:23.017643 23180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:33173 every 8 connection(s)
I20260812 00:04:23.018028 22963 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:04:23.023180 22495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:23.018813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:41253 (local address 127.25.103.126:33149)
0812 00:04:23.018877 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:23.018879 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:23.019048 (+ 169us) server_negotiation.cc:407] Connection header received
0812 00:04:23.019535 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:23.019536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:23.019545 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:23.019613 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:23.020306 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.020818 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.021844 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.022094 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.022157 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:23.022953 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:23.022955 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:23.022955 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:23.022960 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:23.022976 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:23.022980 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:23.023022 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:23.023081 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 00:04:23.023105 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:04:23.023368 23183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:23.018744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:33149 (local address 127.25.103.67:41253)
0812 00:04:23.018936 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:23.018973 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:23.019448 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:23.019671 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:23.019674 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:23.019682 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:23.020212 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:23.020216 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.020909 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.020910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:23.021738 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:23.021741 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.022180 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.022181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:23.022320 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:23.022822 (+ 502us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:04:23.022823 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:23.022852 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:04:23.022876 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:23.023024 (+ 148us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:23.023026 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:23.023028 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:04:23.023073 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 00:04:23.023170 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":68,"threads_started":1}
I20260812 00:04:23.023936 23181 heartbeater.cc:347] Connected to a master server at 127.25.103.126:33149
I20260812 00:04:23.024036 23181 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:23.024225 23181 heartbeater.cc:511] Master 127.25.103.126:33149 requested a full tablet report, sending...
I20260812 00:04:23.024555 22434 ts_manager.cc:194] Registered new tserver with Master: b3875cb9ad4b4e7493c644c0a5005f96 (127.25.103.67:33173)
I20260812 00:04:23.024897 22434 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.103.67:41253
I20260812 00:04:23.026141 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 22963
I20260812 00:04:23.026237 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:04:23.026417 26013 external_mini_cluster.cc:1428] Setting key e1c429eb0bc2f5a3183f48f033aa85d6
I20260812 00:04:23.027096 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:04:23.031272 22495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:23.028516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47892 (local address 127.25.103.126:33149)
0812 00:04:23.028590 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:23.028592 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:23.028663 (+ 71us) server_negotiation.cc:407] Connection header received
0812 00:04:23.028727 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:23.028728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:23.028743 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:23.028797 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:23.028943 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.029424 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.030194 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.030392 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.030448 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:23.031049 (+ 601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:23.031051 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:23.031051 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:23.031056 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:23.031071 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:23.031075 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:23.031119 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:23.031171 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 00:04:23.031195 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 00:04:23.032815 22434 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47892:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:04:23.034437 22434 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:04:23.041206 23197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:23.036903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37254 (local address 127.25.103.67:33173)
0812 00:04:23.037530 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:23.037535 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:23.037566 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:04:23.037603 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:23.037605 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:23.037619 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:23.037688 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:23.038241 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.039139 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.040320 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.040813 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.040879 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:23.040975 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:23.041085 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 00:04:23.041121 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":93,"threads_started":1}
I20260812 00:04:23.041198 23194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:23.036816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:33173 (local address 127.0.0.1:37254)
0812 00:04:23.037144 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:23.037154 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:23.037208 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:23.037882 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:23.037882 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:23.037884 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:23.037928 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:23.037929 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.039216 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.039218 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:23.040250 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:23.040252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.040893 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.040894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:23.040974 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:23.040999 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 00:04:23.041060 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 00:04:23.041115 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":1,"thread_start_us":74,"threads_started":1}
I20260812 00:04:23.041386 23202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:23.037315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56234 (local address 127.25.103.66:40113)
0812 00:04:23.037486 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:23.037490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:23.038001 (+ 511us) server_negotiation.cc:407] Connection header received
0812 00:04:23.038049 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:23.038052 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:23.038067 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:23.038137 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:23.038247 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.039011 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.040088 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.040831 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.040899 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:23.040986 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:23.041249 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 00:04:23.041291 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":78,"threads_started":1}
I20260812 00:04:23.041453 23198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:23.037014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:40113 (local address 127.0.0.1:56234)
0812 00:04:23.037775 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:23.037784 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:23.037830 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:23.038135 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:23.038136 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:23.038138 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:23.038174 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:23.038176 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.039100 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.039101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:23.040002 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:23.040005 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.041027 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.041028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:23.041097 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:23.041100 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:04:23.041149 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 00:04:23.041201 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":745,"mutex_wait_us":2,"thread_start_us":79,"threads_started":1}
I20260812 00:04:23.041615 23196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:23.036784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:36689 (local address 127.0.0.1:37344)
0812 00:04:23.036965 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:23.037004 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:23.037093 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:23.037439 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:23.037442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:23.037445 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:23.037521 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:23.037523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.038791 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.038792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:23.040071 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:23.040074 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.041025 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.041027 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:23.041095 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:23.041099 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:04:23.041149 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 00:04:23.041201 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":12,"thread_start_us":70,"threads_started":1}
I20260812 00:04:23.041983 23201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:23.037100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37344 (local address 127.25.103.65:36689)
0812 00:04:23.037287 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:23.037290 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:23.037299 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:04:23.037330 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:23.037332 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:23.037344 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:23.037410 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:23.037603 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.038703 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.040153 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.040831 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.040899 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:23.040986 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:23.041249 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 00:04:23.041880 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":111,"threads_started":1}
I20260812 00:04:23.042021 23068 tablet_service.cc:1467] Processing CreateTablet for tablet 04f37c7b741340ac95159b783ceca3f4 (DEFAULT_TABLE table=test-table [id=8546cc72ecd5441e8cd1e7572fae9d62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:23.042107 22854 tablet_service.cc:1467] Processing CreateTablet for tablet 04f37c7b741340ac95159b783ceca3f4 (DEFAULT_TABLE table=test-table [id=8546cc72ecd5441e8cd1e7572fae9d62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:23.042413 23068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04f37c7b741340ac95159b783ceca3f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:23.042456 22854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04f37c7b741340ac95159b783ceca3f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:23.044930 23203 tablet_bootstrap.cc:492] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f: Bootstrap starting.
I20260812 00:04:23.044981 23205 tablet_bootstrap.cc:492] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96: Bootstrap starting.
I20260812 00:04:23.045480 22647 tablet_service.cc:1467] Processing CreateTablet for tablet 04f37c7b741340ac95159b783ceca3f4 (DEFAULT_TABLE table=test-table [id=8546cc72ecd5441e8cd1e7572fae9d62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:23.045631 23205 tablet_bootstrap.cc:654] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:23.045634 23203 tablet_bootstrap.cc:654] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:23.045854 22647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04f37c7b741340ac95159b783ceca3f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:23.045928 23205 log.cc:824] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:23.046038 23203 log.cc:824] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:23.046702 23205 tablet_bootstrap.cc:492] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96: No bootstrap required, opened a new log
I20260812 00:04:23.046772 23205 ts_tablet_manager.cc:1397] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:04:23.046957 23203 tablet_bootstrap.cc:492] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f: No bootstrap required, opened a new log
I20260812 00:04:23.047039 23203 ts_tablet_manager.cc:1397] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:04:23.048787 23205 raft_consensus.cc:348] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863185361d4f4d84855ec47322f5c8ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 36689 } } peers { permanent_uuid: "b3875cb9ad4b4e7493c644c0a5005f96" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 33173 } } peers { permanent_uuid: "19d1badd34e7475a9b8d68a14da3ec8f" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 40113 } }
I20260812 00:04:23.048931 23205 raft_consensus.cc:374] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:23.048965 23205 raft_consensus.cc:729] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3875cb9ad4b4e7493c644c0a5005f96, State: Initialized, Role: FOLLOWER
I20260812 00:04:23.049081 23205 consensus_queue.cc:260] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863185361d4f4d84855ec47322f5c8ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 36689 } } peers { permanent_uuid: "b3875cb9ad4b4e7493c644c0a5005f96" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 33173 } } peers { permanent_uuid: "19d1badd34e7475a9b8d68a14da3ec8f" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 40113 } }
I20260812 00:04:23.049340 23205 ts_tablet_manager.cc:1428] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:04:23.049342 23212 tablet_bootstrap.cc:492] T 04f37c7b741340ac95159b783ceca3f4 P 863185361d4f4d84855ec47322f5c8ca: Bootstrap starting.
I20260812 00:04:23.049527 23181 heartbeater.cc:503] Master 127.25.103.126:33149 was elected leader, sending a full tablet report...
I20260812 00:04:23.049487 23203 raft_consensus.cc:348] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863185361d4f4d84855ec47322f5c8ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 36689 } } peers { permanent_uuid: "b3875cb9ad4b4e7493c644c0a5005f96" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 33173 } } peers { permanent_uuid: "19d1badd34e7475a9b8d68a14da3ec8f" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 40113 } }
I20260812 00:04:23.049644 23203 raft_consensus.cc:374] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:23.049683 23203 raft_consensus.cc:729] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19d1badd34e7475a9b8d68a14da3ec8f, State: Initialized, Role: FOLLOWER
I20260812 00:04:23.049784 23203 consensus_queue.cc:260] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863185361d4f4d84855ec47322f5c8ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 36689 } } peers { permanent_uuid: "b3875cb9ad4b4e7493c644c0a5005f96" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 33173 } } peers { permanent_uuid: "19d1badd34e7475a9b8d68a14da3ec8f" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 40113 } }
I20260812 00:04:23.050067 23203 ts_tablet_manager.cc:1428] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:04:23.050107 23212 tablet_bootstrap.cc:654] T 04f37c7b741340ac95159b783ceca3f4 P 863185361d4f4d84855ec47322f5c8ca: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:23.050124 22955 heartbeater.cc:503] Master 127.25.103.126:33149 was elected leader, sending a full tablet report...
I20260812 00:04:23.050419 23212 log.cc:824] T 04f37c7b741340ac95159b783ceca3f4 P 863185361d4f4d84855ec47322f5c8ca: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:23.051250 23212 tablet_bootstrap.cc:492] T 04f37c7b741340ac95159b783ceca3f4 P 863185361d4f4d84855ec47322f5c8ca: No bootstrap required, opened a new log
I20260812 00:04:23.051322 23212 ts_tablet_manager.cc:1397] T 04f37c7b741340ac95159b783ceca3f4 P 863185361d4f4d84855ec47322f5c8ca: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:04:23.053063 23212 raft_consensus.cc:348] T 04f37c7b741340ac95159b783ceca3f4 P 863185361d4f4d84855ec47322f5c8ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863185361d4f4d84855ec47322f5c8ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 36689 } } peers { permanent_uuid: "b3875cb9ad4b4e7493c644c0a5005f96" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 33173 } } peers { permanent_uuid: "19d1badd34e7475a9b8d68a14da3ec8f" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 40113 } }
I20260812 00:04:23.053196 23212 raft_consensus.cc:374] T 04f37c7b741340ac95159b783ceca3f4 P 863185361d4f4d84855ec47322f5c8ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:23.053217 23212 raft_consensus.cc:729] T 04f37c7b741340ac95159b783ceca3f4 P 863185361d4f4d84855ec47322f5c8ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 863185361d4f4d84855ec47322f5c8ca, State: Initialized, Role: FOLLOWER
I20260812 00:04:23.053311 23212 consensus_queue.cc:260] T 04f37c7b741340ac95159b783ceca3f4 P 863185361d4f4d84855ec47322f5c8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863185361d4f4d84855ec47322f5c8ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 36689 } } peers { permanent_uuid: "b3875cb9ad4b4e7493c644c0a5005f96" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 33173 } } peers { permanent_uuid: "19d1badd34e7475a9b8d68a14da3ec8f" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 40113 } }
I20260812 00:04:23.053550 23212 ts_tablet_manager.cc:1428] T 04f37c7b741340ac95159b783ceca3f4 P 863185361d4f4d84855ec47322f5c8ca: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:04:23.053633 22750 heartbeater.cc:503] Master 127.25.103.126:33149 was elected leader, sending a full tablet report...
W20260812 00:04:23.144771 22958 tablet.cc:2369] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:04:23.266108 22751 tablet.cc:2369] T 04f37c7b741340ac95159b783ceca3f4 P 863185361d4f4d84855ec47322f5c8ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:04:23.268545 23182 tablet.cc:2369] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:04:23.290186 23213 raft_consensus.cc:482] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:23.290328 23213 raft_consensus.cc:504] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863185361d4f4d84855ec47322f5c8ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 36689 } } peers { permanent_uuid: "b3875cb9ad4b4e7493c644c0a5005f96" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 33173 } } peers { permanent_uuid: "19d1badd34e7475a9b8d68a14da3ec8f" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 40113 } }
I20260812 00:04:23.290732 23213 leader_election.cc:288] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 863185361d4f4d84855ec47322f5c8ca (127.25.103.65:36689), 19d1badd34e7475a9b8d68a14da3ec8f (127.25.103.66:40113)
I20260812 00:04:23.293646 23201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:23.291025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:38969 (local address 127.25.103.65:36689)
0812 00:04:23.291078 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:23.291080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:23.291098 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:04:23.291220 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:23.291221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:23.291231 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:23.291285 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:23.291476 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.291979 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.292966 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.293317 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.293388 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:23.293397 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:23.293536 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 00:04:23.293575 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:04:23.293678 23183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:23.290920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:36689 (local address 127.25.103.67:38969)
0812 00:04:23.290986 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:23.291004 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:23.291090 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:23.291297 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:23.291298 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:23.291300 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:23.291399 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:23.291402 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.292067 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.292068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:23.292867 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:23.292869 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.293401 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.293403 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:23.293469 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:23.293472 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:04:23.293525 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 00:04:23.293569 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":29}
I20260812 00:04:23.293709 23202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:23.291120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:35795 (local address 127.25.103.66:40113)
0812 00:04:23.291174 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:23.291180 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:23.291270 (+ 90us) server_negotiation.cc:407] Connection header received
0812 00:04:23.291329 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:23.291331 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:23.291339 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:23.291383 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:23.291536 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.292079 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.293023 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.293386 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.293449 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:23.293456 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:23.293598 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 00:04:23.293642 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:04:23.293792 23220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:23.291024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:40113 (local address 127.25.103.67:35795)
0812 00:04:23.291194 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:23.291203 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:23.291261 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:23.291398 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:23.291399 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:23.291400 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:23.291475 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:23.291476 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.292193 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.292194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:23.292938 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:23.292940 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.293463 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.293464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:23.293534 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:23.293538 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:04:23.293582 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:04:23.293623 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":106,"threads_started":1}
I20260812 00:04:23.294188 22885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04f37c7b741340ac95159b783ceca3f4" candidate_uuid: "b3875cb9ad4b4e7493c644c0a5005f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19d1badd34e7475a9b8d68a14da3ec8f" is_pre_election: true
I20260812 00:04:23.294226 22677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04f37c7b741340ac95159b783ceca3f4" candidate_uuid: "b3875cb9ad4b4e7493c644c0a5005f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "863185361d4f4d84855ec47322f5c8ca" is_pre_election: true
I20260812 00:04:23.294343 22885 raft_consensus.cc:2454] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3875cb9ad4b4e7493c644c0a5005f96 in term 0.
I20260812 00:04:23.294353 22677 raft_consensus.cc:2454] T 04f37c7b741340ac95159b783ceca3f4 P 863185361d4f4d84855ec47322f5c8ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3875cb9ad4b4e7493c644c0a5005f96 in term 0.
I20260812 00:04:23.294569 22988 leader_election.cc:302] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19d1badd34e7475a9b8d68a14da3ec8f, b3875cb9ad4b4e7493c644c0a5005f96; no voters:
I20260812 00:04:23.294725 23213 raft_consensus.cc:2781] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:04:23.294795 23213 raft_consensus.cc:482] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:04:23.294813 23213 raft_consensus.cc:3037] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:23.295560 23213 raft_consensus.cc:504] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863185361d4f4d84855ec47322f5c8ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 36689 } } peers { permanent_uuid: "b3875cb9ad4b4e7493c644c0a5005f96" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 33173 } } peers { permanent_uuid: "19d1badd34e7475a9b8d68a14da3ec8f" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 40113 } }
I20260812 00:04:23.295680 23213 leader_election.cc:288] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [CANDIDATE]: Term 1 election: Requested vote from peers 863185361d4f4d84855ec47322f5c8ca (127.25.103.65:36689), 19d1badd34e7475a9b8d68a14da3ec8f (127.25.103.66:40113)
I20260812 00:04:23.295841 22677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04f37c7b741340ac95159b783ceca3f4" candidate_uuid: "b3875cb9ad4b4e7493c644c0a5005f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "863185361d4f4d84855ec47322f5c8ca"
I20260812 00:04:23.295909 22885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04f37c7b741340ac95159b783ceca3f4" candidate_uuid: "b3875cb9ad4b4e7493c644c0a5005f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19d1badd34e7475a9b8d68a14da3ec8f"
I20260812 00:04:23.295922 22677 raft_consensus.cc:3037] T 04f37c7b741340ac95159b783ceca3f4 P 863185361d4f4d84855ec47322f5c8ca [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:23.296058 22885 raft_consensus.cc:3037] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:23.296679 22677 raft_consensus.cc:2454] T 04f37c7b741340ac95159b783ceca3f4 P 863185361d4f4d84855ec47322f5c8ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3875cb9ad4b4e7493c644c0a5005f96 in term 1.
I20260812 00:04:23.296824 22885 raft_consensus.cc:2454] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3875cb9ad4b4e7493c644c0a5005f96 in term 1.
I20260812 00:04:23.296864 22988 leader_election.cc:302] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 863185361d4f4d84855ec47322f5c8ca, b3875cb9ad4b4e7493c644c0a5005f96; no voters:
I20260812 00:04:23.296969 23213 raft_consensus.cc:2781] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:23.297150 23213 raft_consensus.cc:686] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [term 1 LEADER]: Becoming Leader. State: Replica: b3875cb9ad4b4e7493c644c0a5005f96, State: Running, Role: LEADER
I20260812 00:04:23.297235 23213 consensus_queue.cc:237] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863185361d4f4d84855ec47322f5c8ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 36689 } } peers { permanent_uuid: "b3875cb9ad4b4e7493c644c0a5005f96" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 33173 } } peers { permanent_uuid: "19d1badd34e7475a9b8d68a14da3ec8f" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 40113 } }
I20260812 00:04:23.298152 22434 catalog_manager.cc:5495] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3875cb9ad4b4e7493c644c0a5005f96 (127.25.103.67). New cstate: current_term: 1 leader_uuid: "b3875cb9ad4b4e7493c644c0a5005f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863185361d4f4d84855ec47322f5c8ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 36689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3875cb9ad4b4e7493c644c0a5005f96" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 33173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19d1badd34e7475a9b8d68a14da3ec8f" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 40113 } health_report { overall_health: UNKNOWN } } }
I20260812 00:04:23.326347 23197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:23.324090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37258 (local address 127.25.103.67:33173)
0812 00:04:23.324150 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:23.324153 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:23.324162 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:04:23.324205 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:23.324206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:23.324225 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:23.324281 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:04:23.324393 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.324872 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.325582 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.325782 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.325833 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:23.326021 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:04:23.326130 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:04:23.326190 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:23.326228 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 00:04:23.326245 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:04:23.328320 22677 raft_consensus.cc:1261] T 04f37c7b741340ac95159b783ceca3f4 P 863185361d4f4d84855ec47322f5c8ca [term 1 FOLLOWER]: Refusing update from remote peer b3875cb9ad4b4e7493c644c0a5005f96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:23.328320 22885 raft_consensus.cc:1261] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f [term 1 FOLLOWER]: Refusing update from remote peer b3875cb9ad4b4e7493c644c0a5005f96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:23.328756 23221 consensus_queue.cc:1035] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19d1badd34e7475a9b8d68a14da3ec8f" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:23.328908 23213 consensus_queue.cc:1035] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "863185361d4f4d84855ec47322f5c8ca" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 36689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:23.331621 23228 mvcc.cc:205] Tried to move back new op lower bound from 7317475587389706240 to 7317475587266084864. Current Snapshot: MvccSnapshot[applied={T|T < 7317475587389706240}]
I20260812 00:04:23.331775 23227 mvcc.cc:205] Tried to move back new op lower bound from 7317475587389706240 to 7317475587266084864. Current Snapshot: MvccSnapshot[applied={T|T < 7317475587389706240}]
I20260812 00:04:23.333420 22432 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:23.333523 22432 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:23.334306 22432 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9afcb9f2e0cc4cd6af91d2c1de627d56: Sending DeleteTablet for 3 replicas of tablet 04f37c7b741340ac95159b783ceca3f4
I20260812 00:04:23.334585 22647 tablet_service.cc:1514] Processing DeleteTablet for tablet 04f37c7b741340ac95159b783ceca3f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:23 UTC) from {username='slave'} at 127.0.0.1:37344
I20260812 00:04:23.334754 23068 tablet_service.cc:1514] Processing DeleteTablet for tablet 04f37c7b741340ac95159b783ceca3f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:23 UTC) from {username='slave'} at 127.0.0.1:37254
I20260812 00:04:23.334830 22854 tablet_service.cc:1514] Processing DeleteTablet for tablet 04f37c7b741340ac95159b783ceca3f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:23 UTC) from {username='slave'} at 127.0.0.1:56234
I20260812 00:04:23.334816 23242 tablet_replica.cc:330] T 04f37c7b741340ac95159b783ceca3f4 P 863185361d4f4d84855ec47322f5c8ca: stopping tablet replica
I20260812 00:04:23.335047 23242 raft_consensus.cc:2229] T 04f37c7b741340ac95159b783ceca3f4 P 863185361d4f4d84855ec47322f5c8ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:04:23.335083 23244 tablet_replica.cc:330] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96: stopping tablet replica
I20260812 00:04:23.335166 23244 raft_consensus.cc:2229] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:04:23.335238 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 22538
I20260812 00:04:23.335264 23244 raft_consensus.cc:2258] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:23.335330 23242 raft_consensus.cc:2258] T 04f37c7b741340ac95159b783ceca3f4 P 863185361d4f4d84855ec47322f5c8ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:23.335402 23247 tablet_replica.cc:330] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f: stopping tablet replica
I20260812 00:04:23.335531 23247 raft_consensus.cc:2229] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:04:23.335613 23247 raft_consensus.cc:2258] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:23.336002 23247 ts_tablet_manager.cc:1905] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:04:23.338698 23244 ts_tablet_manager.cc:1905] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:04:23.339850 23244 ts_tablet_manager.cc:1918] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:23.339921 23244 log.cc:1196] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/04f37c7b741340ac95159b783ceca3f4
I20260812 00:04:23.340142 23244 ts_tablet_manager.cc:1939] T 04f37c7b741340ac95159b783ceca3f4 P b3875cb9ad4b4e7493c644c0a5005f96: Deleting consensus metadata
I20260812 00:04:23.340485 23247 ts_tablet_manager.cc:1918] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:23.340559 23247 log.cc:1196] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/04f37c7b741340ac95159b783ceca3f4
I20260812 00:04:23.340762 23247 ts_tablet_manager.cc:1939] T 04f37c7b741340ac95159b783ceca3f4 P 19d1badd34e7475a9b8d68a14da3ec8f: Deleting consensus metadata
I20260812 00:04:23.343525 22407 catalog_manager.cc:4841] TS b3875cb9ad4b4e7493c644c0a5005f96 (127.25.103.67:33173): tablet 04f37c7b741340ac95159b783ceca3f4 (table test-table [id=8546cc72ecd5441e8cd1e7572fae9d62]) successfully deleted
I20260812 00:04:23.345463 22406 catalog_manager.cc:4841] TS 19d1badd34e7475a9b8d68a14da3ec8f (127.25.103.66:40113): tablet 04f37c7b741340ac95159b783ceca3f4 (table test-table [id=8546cc72ecd5441e8cd1e7572fae9d62]) successfully deleted
W20260812 00:04:23.349303 22406 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.103.65:36689 (error 108)
I20260812 00:04:23.349843 23198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:23.349704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:36689 (local address 127.0.0.1:37354)
0812 00:04:23.349762 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:23.349807 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:36689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 00:04:23.349884 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 22753
W20260812 00:04:23.357055 22406 catalog_manager.cc:4584] TS 863185361d4f4d84855ec47322f5c8ca (127.25.103.65:36689): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 04f37c7b741340ac95159b783ceca3f4: Network error: Client connection negotiation failed: client connection to 127.25.103.65:36689: connect: Connection refused (error 111)
I20260812 00:04:23.364045 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 22963
I20260812 00:04:23.379004 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 22376
2026-08-12T00:04:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (996 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:23 dist-test-slave-vpvm krb5kdc[23254](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:23 dist-test-slave-vpvm krb5kdc[23254](info): set up 2 sockets
Aug 12 00:04:23 dist-test-slave-vpvm krb5kdc[23254](info): commencing operation
krb5kdc: starting...
W20260812 00:04:24.555979 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:24 dist-test-slave-vpvm krb5kdc[23254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493064, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:04:24.674422 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:44941
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:44941
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:24.755460 23274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:24.755689 23274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:24.755721 23274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:24.756872 23274 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:24.756916 23274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:24.756934 23274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:24.756953 23274 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:24.756968 23274 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:24.758515 23274 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:44941
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:44941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:24.758761 23274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:24.758980 23274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:04:24.763743 23274 server_base.cc:1034] running on GCE node
W20260812 00:04:24.763705 23280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:24.763738 23279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:24.763710 23282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:24.764098 23274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:24.764385 23274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:24.765534 23274 hybrid_clock.cc:648] HybridClock initialized: now 1786493064765522 us; error 29 us; skew 500 ppm
Aug 12 00:04:24 dist-test-slave-vpvm krb5kdc[23254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493064, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:24.770744 23274 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:04:24.771178 23274 webserver.cc:460] Webserver started at http://127.25.103.126:45477/ using document root <none> and password file <none>
I20260812 00:04:24.771394 23274 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:24.771457 23274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:24.771605 23274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:24.772661 23274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "3b2be8d87aa44b13a54822c9929f3cb0"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-vpvm"
server_key: "44abee8a10e3454ced6de7bb18aed0c5"
server_key_iv: "1966e7efaaefe2faaafcce1f8ee3bcd7"
server_key_version: "encryptionkey@0"
I20260812 00:04:24.773007 23274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "3b2be8d87aa44b13a54822c9929f3cb0"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-vpvm"
server_key: "44abee8a10e3454ced6de7bb18aed0c5"
server_key_iv: "1966e7efaaefe2faaafcce1f8ee3bcd7"
server_key_version: "encryptionkey@0"
I20260812 00:04:24.774343 23274 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 00:04:24.775077 23293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:24.775235 23274 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:24.775321 23274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "3b2be8d87aa44b13a54822c9929f3cb0"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-vpvm"
server_key: "44abee8a10e3454ced6de7bb18aed0c5"
server_key_iv: "1966e7efaaefe2faaafcce1f8ee3bcd7"
server_key_version: "encryptionkey@0"
I20260812 00:04:24.775382 23274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:24.790794 23274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:24.792802 23274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:24.792974 23274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:24.797008 23274 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:44941
I20260812 00:04:24.797065 23378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:44941 every 8 connection(s)
I20260812 00:04:24.797391 23274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:24.798329 23380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:24.799959 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 23274
I20260812 00:04:24.800061 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:24.800226 26013 external_mini_cluster.cc:1428] Setting key 6e81c4a03ac96f66c747cd913284faef
I20260812 00:04:24.800797 23380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0: Bootstrap starting.
I20260812 00:04:24.801360 23380 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:24.801631 23380 log.cc:824] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:24.802266 23380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0: No bootstrap required, opened a new log
I20260812 00:04:24.804023 23380 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b2be8d87aa44b13a54822c9929f3cb0" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 44941 } }
I20260812 00:04:24.804153 23380 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:24.804185 23380 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b2be8d87aa44b13a54822c9929f3cb0, State: Initialized, Role: FOLLOWER
I20260812 00:04:24.804308 23380 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b2be8d87aa44b13a54822c9929f3cb0" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 44941 } }
I20260812 00:04:24.804380 23380 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:24.804411 23380 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:24.804458 23380 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:24.805037 23380 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b2be8d87aa44b13a54822c9929f3cb0" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 44941 } }
I20260812 00:04:24.805145 23380 leader_election.cc:302] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b2be8d87aa44b13a54822c9929f3cb0; no voters:
I20260812 00:04:24.805294 23380 leader_election.cc:288] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:24.805325 23386 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:24.805444 23386 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0 [term 1 LEADER]: Becoming Leader. State: Replica: 3b2be8d87aa44b13a54822c9929f3cb0, State: Running, Role: LEADER
I20260812 00:04:24.805553 23380 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:24.805619 23386 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b2be8d87aa44b13a54822c9929f3cb0" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 44941 } }
I20260812 00:04:24.805997 23386 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b2be8d87aa44b13a54822c9929f3cb0. Latest consensus state: current_term: 1 leader_uuid: "3b2be8d87aa44b13a54822c9929f3cb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b2be8d87aa44b13a54822c9929f3cb0" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 44941 } } }
I20260812 00:04:24.806013 23387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b2be8d87aa44b13a54822c9929f3cb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b2be8d87aa44b13a54822c9929f3cb0" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 44941 } } }
I20260812 00:04:24.806123 23386 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:24.806221 23387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:24.806416 23395 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 12 00:04:24 dist-test-slave-vpvm krb5kdc[23254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493064, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:04:24.806998 23395 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:24.808719 23395 catalog_manager.cc:1347] Generated new cluster ID: e8ae8cb9ba2b455e828b17eb6d4dcb66
I20260812 00:04:24.808769 23395 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:24.810933 23384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:24.800757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39116 (local address 127.25.103.126:44941)
0812 00:04:24.800955 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:24.800973 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:24.801014 (+ 41us) server_negotiation.cc:407] Connection header received
0812 00:04:24.801456 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:24.801464 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:24.801524 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:24.801649 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:24.802301 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:24.803219 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:24.803929 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:24.804383 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:24.804480 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:24.807423 (+ 2943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:24.807427 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:24.807427 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:24.807438 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:24.809351 (+ 1913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:24.809716 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:24.809719 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:24.809719 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:24.809823 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:24.810013 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:24.810014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:24.810014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:24.810315 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:24.810479 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:24.810565 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 00:04:24.810707 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":82,"threads_started":1}
I20260812 00:04:24.821741 23395 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:24.822359 23395 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:24.825731 23395 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0: Generated new TSK 0
I20260812 00:04:24.825933 23395 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
I20260812 00:04:24.853920 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:44941
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:24.936034 23419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:24.936239 23419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:24.936262 23419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:24.937363 23419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:24.937408 23419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:24.937433 23419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:04:24.938892 23419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:44941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:24.939106 23419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:24.939314 23419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:24.944164 23432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:24.944159 23428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:24.944465 23419 server_base.cc:1034] running on GCE node
W20260812 00:04:24.944231 23430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:24.944743 23419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:24.944978 23419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:24.946138 23419 hybrid_clock.cc:648] HybridClock initialized: now 1786493064946117 us; error 36 us; skew 500 ppm
Aug 12 00:04:24 dist-test-slave-vpvm krb5kdc[23254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493064, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:24.948764 23419 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:04:24.949226 23419 webserver.cc:460] Webserver started at http://127.25.103.65:35459/ using document root <none> and password file <none>
I20260812 00:04:24.949435 23419 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:24.949488 23419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:24.949626 23419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:24.950866 23419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "26187cb42eb44ffb8fff5f71961edd0d"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-vpvm"
server_key: "642c9cd0ec357aecb36971613e5c8372"
server_key_iv: "7706a017cec5d1d396d3b67bf9a0327a"
server_key_version: "encryptionkey@0"
I20260812 00:04:24.951228 23419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "26187cb42eb44ffb8fff5f71961edd0d"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-vpvm"
server_key: "642c9cd0ec357aecb36971613e5c8372"
server_key_iv: "7706a017cec5d1d396d3b67bf9a0327a"
server_key_version: "encryptionkey@0"
I20260812 00:04:24.952571 23419 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:04:24.953295 23446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:24.953439 23419 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:04:24.953538 23419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "26187cb42eb44ffb8fff5f71961edd0d"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-vpvm"
server_key: "642c9cd0ec357aecb36971613e5c8372"
server_key_iv: "7706a017cec5d1d396d3b67bf9a0327a"
server_key_version: "encryptionkey@0"
I20260812 00:04:24.953599 23419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:24.962117 23419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:24.963922 23419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:24.964054 23419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:24.964257 23419 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:24.964557 23419 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:24.964592 23419 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:24.964620 23419 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:24.964644 23419 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:24.970383 23419 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:43033
I20260812 00:04:24.970427 23627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:43033 every 8 connection(s)
I20260812 00:04:24.970742 23419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:04:24 dist-test-slave-vpvm krb5kdc[23254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493064, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:04:24.979176 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 23419
I20260812 00:04:24.979283 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:04:24.979452 23384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:24.971440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:33119 (local address 127.25.103.126:44941)
0812 00:04:24.971497 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:24.971500 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:24.971682 (+ 182us) server_negotiation.cc:407] Connection header received
0812 00:04:24.972159 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:24.972160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:24.972171 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:24.972222 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:24.973123 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:24.973652 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:24.974705 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:24.974922 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:24.974975 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:24.976896 (+ 1921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:24.976898 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:24.976898 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:24.976904 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:24.978162 (+ 1258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:24.978522 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:24.978523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:24.978524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:24.978582 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:24.978829 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:24.978830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:24.978831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:24.978936 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:24.978991 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:24.979273 (+ 282us) server_negotiation.cc:299] Negotiation successful
0812 00:04:24.979359 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:04:24.979490 26013 external_mini_cluster.cc:1428] Setting key 4e06b6fac61f50c699435b4b1476a958
I20260812 00:04:24.979606 23633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:24.971409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:44941 (local address 127.25.103.65:33119)
0812 00:04:24.971567 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:24.971602 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:24.972072 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:24.972273 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:24.972276 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:24.972842 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:24.973038 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:24.973043 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:24.973747 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:24.973748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:24.974628 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:24.974631 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:24.974984 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:24.974985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:24.975082 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:24.975513 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:24.975521 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:24.976820 (+ 1299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:24.978229 (+ 1409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:24.978235 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:24.978236 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:24.978433 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:24.978648 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:24.978649 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:24.978650 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:24.978772 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:24.978990 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:24.979011 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:24.979157 (+ 146us) client_negotiation.cc:769] Sending connection context
0812 00:04:24.979245 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 00:04:24.979398 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":81,"threads_started":1}
I20260812 00:04:24.980170 23631 heartbeater.cc:347] Connected to a master server at 127.25.103.126:44941
I20260812 00:04:24.980268 23631 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:24.980433 23631 heartbeater.cc:511] Master 127.25.103.126:44941 requested a full tablet report, sending...
I20260812 00:04:24.980975 23323 ts_manager.cc:194] Registered new tserver with Master: 26187cb42eb44ffb8fff5f71961edd0d (127.25.103.65:43033)
I20260812 00:04:24.981771 23323 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:33119
WARNING: no policy specified for kudu/127.25.103.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
I20260812 00:04:25.004086 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:44941
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:25.087425 23636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:25.087635 23636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:25.087666 23636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:25.088792 23636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:25.088835 23636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:25.088871 23636 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:04:25.090348 23636 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:44941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23636
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:25.090603 23636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:25.090819 23636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:25.095805 23653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:25.095811 23648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:25.095822 23646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:25.095937 23636 server_base.cc:1034] running on GCE node
I20260812 00:04:25.096199 23636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:25.096454 23636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:25.097626 23636 hybrid_clock.cc:648] HybridClock initialized: now 1786493065097609 us; error 28 us; skew 500 ppm
Aug 12 00:04:25 dist-test-slave-vpvm krb5kdc[23254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:25.100276 23636 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:04:25.100729 23636 webserver.cc:460] Webserver started at http://127.25.103.66:43613/ using document root <none> and password file <none>
I20260812 00:04:25.100968 23636 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:25.101017 23636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:25.101147 23636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:25.102259 23636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "740efb21b81d4f1ba3f8970fc103ec09"
format_stamp: "Formatted at 2026-08-12 00:04:25 on dist-test-slave-vpvm"
server_key: "38fa32d225957d4eb3d4039790f24bbe"
server_key_iv: "4ababd706a1434d1b4f7c58f28282317"
server_key_version: "encryptionkey@0"
I20260812 00:04:25.102597 23636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "740efb21b81d4f1ba3f8970fc103ec09"
format_stamp: "Formatted at 2026-08-12 00:04:25 on dist-test-slave-vpvm"
server_key: "38fa32d225957d4eb3d4039790f24bbe"
server_key_iv: "4ababd706a1434d1b4f7c58f28282317"
server_key_version: "encryptionkey@0"
I20260812 00:04:25.103936 23636 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:04:25.104805 23663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.104966 23636 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:25.105067 23636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "740efb21b81d4f1ba3f8970fc103ec09"
format_stamp: "Formatted at 2026-08-12 00:04:25 on dist-test-slave-vpvm"
server_key: "38fa32d225957d4eb3d4039790f24bbe"
server_key_iv: "4ababd706a1434d1b4f7c58f28282317"
server_key_version: "encryptionkey@0"
I20260812 00:04:25.105140 23636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:25.112519 23636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:25.114498 23636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:25.114642 23636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:25.114853 23636 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:25.115160 23636 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:25.115195 23636 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.115226 23636 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:25.115243 23636 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.121173 23636 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:34629
I20260812 00:04:25.121212 23855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:34629 every 8 connection(s)
I20260812 00:04:25.121537 23636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:04:25 dist-test-slave-vpvm krb5kdc[23254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:04:25.130048 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 23636
I20260812 00:04:25.130162 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:04:25.130358 26013 external_mini_cluster.cc:1428] Setting key 12d018f80fbf576499fe29bdbad86194
I20260812 00:04:25.130719 23384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.122264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:43037 (local address 127.25.103.126:44941)
0812 00:04:25.122324 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.122327 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.122501 (+ 174us) server_negotiation.cc:407] Connection header received
0812 00:04:25.122984 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.122985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.122995 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.123054 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:25.123968 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.124478 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.125468 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.125672 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.125724 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.128045 (+ 2321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:25.128046 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:25.128047 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:25.128053 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:25.129167 (+ 1114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:25.129565 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:25.129566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:25.129566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:25.129624 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:25.129856 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:25.129857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:25.129857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:25.130135 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:25.130202 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.130517 (+ 315us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.130628 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:04:25.130882 23859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.122230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:44941 (local address 127.25.103.66:43037)
0812 00:04:25.122386 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.122429 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.122901 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.123106 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.123109 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.123685 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:25.123883 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.123888 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.124565 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.124566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.125387 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.125390 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.125765 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.125766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.125879 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.126459 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:25.126469 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:25.127948 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:25.129249 (+ 1301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:25.129256 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:25.129258 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:25.129489 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:25.129678 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:25.129678 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:25.129679 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:25.129774 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:25.130208 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:25.130216 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:25.130353 (+ 137us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.130475 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.130659 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":71,"threads_started":1}
I20260812 00:04:25.131318 23856 heartbeater.cc:347] Connected to a master server at 127.25.103.126:44941
I20260812 00:04:25.131424 23856 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:25.131606 23856 heartbeater.cc:511] Master 127.25.103.126:44941 requested a full tablet report, sending...
I20260812 00:04:25.132030 23323 ts_manager.cc:194] Registered new tserver with Master: 740efb21b81d4f1ba3f8970fc103ec09 (127.25.103.66:34629)
I20260812 00:04:25.132417 23323 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:43037
WARNING: no policy specified for kudu/127.25.103.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
I20260812 00:04:25.155110 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:44941
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:35283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:25.237126 23864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:25.237350 23864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:25.237376 23864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:25.238559 23864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:25.238603 23864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:25.238629 23864 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:04:25.240113 23864 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:35283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:44941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23864
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:25.240356 23864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:25.240595 23864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:25.245710 23874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:25.245765 23877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:25.245707 23884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:25.245922 23864 server_base.cc:1034] running on GCE node
I20260812 00:04:25.246150 23864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:25.246398 23864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:25.247543 23864 hybrid_clock.cc:648] HybridClock initialized: now 1786493065247538 us; error 38 us; skew 500 ppm
Aug 12 00:04:25 dist-test-slave-vpvm krb5kdc[23254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:25.250105 23864 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:04:25.250533 23864 webserver.cc:460] Webserver started at http://127.25.103.67:46879/ using document root <none> and password file <none>
I20260812 00:04:25.250744 23864 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:25.250784 23864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:25.250877 23864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:25.251874 23864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "3642d7e523904bdcb52f22d4befa5ba5"
format_stamp: "Formatted at 2026-08-12 00:04:25 on dist-test-slave-vpvm"
server_key: "2168795c1480654e34e5205a27753e1c"
server_key_iv: "ef4df9f951be89d75233aba855622411"
server_key_version: "encryptionkey@0"
I20260812 00:04:25.252171 23864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "3642d7e523904bdcb52f22d4befa5ba5"
format_stamp: "Formatted at 2026-08-12 00:04:25 on dist-test-slave-vpvm"
server_key: "2168795c1480654e34e5205a27753e1c"
server_key_iv: "ef4df9f951be89d75233aba855622411"
server_key_version: "encryptionkey@0"
I20260812 00:04:25.253376 23864 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:04:25.254055 23894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.254200 23864 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.254283 23864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "3642d7e523904bdcb52f22d4befa5ba5"
format_stamp: "Formatted at 2026-08-12 00:04:25 on dist-test-slave-vpvm"
server_key: "2168795c1480654e34e5205a27753e1c"
server_key_iv: "ef4df9f951be89d75233aba855622411"
server_key_version: "encryptionkey@0"
I20260812 00:04:25.254344 23864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:25.268112 23864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:25.269991 23864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:25.270117 23864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:25.270314 23864 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:25.270622 23864 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:25.270655 23864 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.270682 23864 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:25.270699 23864 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.276299 23864 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:32931
I20260812 00:04:25.276343 24077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:32931 every 8 connection(s)
I20260812 00:04:25.276662 23864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:04:25.280725 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 23864
I20260812 00:04:25.280844 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:04:25.281037 26013 external_mini_cluster.cc:1428] Setting key 0b4253763eaa4f641ecf0a700d5f1436
Aug 12 00:04:25 dist-test-slave-vpvm krb5kdc[23254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:04:25.285784 23384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.277362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:58335 (local address 127.25.103.126:44941)
0812 00:04:25.277416 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.277418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.277601 (+ 183us) server_negotiation.cc:407] Connection header received
0812 00:04:25.278181 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.278183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.278196 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.278249 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:25.279258 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.279771 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.280751 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.280979 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.281031 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.283377 (+ 2346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:25.283379 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:25.283379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:25.283387 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:25.284520 (+ 1133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:25.284891 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:25.284893 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:25.284893 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:25.284949 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:25.285175 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:25.285175 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:25.285176 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:25.285290 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:25.285346 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.285610 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.285695 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:04:25.285975 24085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.277339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:44941 (local address 127.25.103.67:58335)
0812 00:04:25.277489 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.277526 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.278085 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.278320 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.278323 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.278950 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:25.279161 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.279166 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.279858 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.279859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.280664 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.280666 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.281070 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.281071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.281203 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.281742 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:25.281753 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:25.283287 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:25.284598 (+ 1311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:25.284606 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:25.284608 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:25.284825 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:25.285006 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:25.285007 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:25.285007 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:25.285119 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:25.285346 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:25.285353 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:25.285488 (+ 135us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.285577 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.285738 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":74,"threads_started":1}
I20260812 00:04:25.286542 24078 heartbeater.cc:347] Connected to a master server at 127.25.103.126:44941
I20260812 00:04:25.286640 24078 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:25.286819 24078 heartbeater.cc:511] Master 127.25.103.126:44941 requested a full tablet report, sending...
I20260812 00:04:25.287231 23323 ts_manager.cc:194] Registered new tserver with Master: 3642d7e523904bdcb52f22d4befa5ba5 (127.25.103.67:32931)
I20260812 00:04:25.287613 23323 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:58335
I20260812 00:04:25.292940 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:04:25.300171 23384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.294284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39124 (local address 127.25.103.126:44941)
0812 00:04:25.294351 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.294353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.294474 (+ 121us) server_negotiation.cc:407] Connection header received
0812 00:04:25.294516 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.294517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.294525 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.294576 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:25.295082 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.295585 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.296296 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.296583 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.296650 (+ 67us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.297917 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:25.297919 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:25.297919 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:25.297926 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:25.299130 (+ 1204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:25.299512 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:25.299513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:25.299513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:25.299579 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:25.299730 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:25.299730 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:25.299730 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:25.299859 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:25.299937 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.300051 (+ 114us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.300102 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 00:04:25.301760 23323 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39124:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:04:25.303339 23323 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:04:25.310003 24100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.305766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43520 (local address 127.25.103.65:43033)
0812 00:04:25.305999 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.306004 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.306506 (+ 502us) server_negotiation.cc:407] Connection header received
0812 00:04:25.306554 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.306557 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.306572 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.306637 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:25.306773 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.307649 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.308945 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.309531 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.309606 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.309669 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.309826 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.309873 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":85,"threads_started":1}
I20260812 00:04:25.310011 24099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.305622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:43033 (local address 127.0.0.1:43520)
0812 00:04:25.306395 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.306405 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.306447 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.306660 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.306661 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.306664 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:25.306707 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.306709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.307791 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.307792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.308876 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.308879 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.309618 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.309619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.309718 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.309735 (+ 17us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.309801 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.309874 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":760,"mutex_wait_us":1,"thread_start_us":57,"threads_started":1}
I20260812 00:04:25.310024 24096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.305402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:32931 (local address 127.0.0.1:55086)
0812 00:04:25.305551 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.305603 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.305675 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.306217 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.306220 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.306222 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:25.306299 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.306301 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.307445 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.307446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.308646 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.308649 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.309631 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.309632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.309725 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.309737 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.309806 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.309879 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":27,"spinlock_wait_cycles":768,"thread_start_us":86,"threads_started":1}
I20260812 00:04:25.310299 24101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.305765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55086 (local address 127.25.103.67:32931)
0812 00:04:25.306043 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.306048 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.306070 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:04:25.306110 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.306112 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.306127 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.306209 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:25.306365 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.307344 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.308734 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.309476 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.309542 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.309598 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.310161 (+ 563us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.310214 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":85,"threads_started":1}
I20260812 00:04:25.311028 23520 tablet_service.cc:1467] Processing CreateTablet for tablet 098af17d13a44949b30297f864258f87 (DEFAULT_TABLE table=test-table [id=bfd54b2eea604e6382f99101a903d9b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:25.311028 23979 tablet_service.cc:1467] Processing CreateTablet for tablet 098af17d13a44949b30297f864258f87 (DEFAULT_TABLE table=test-table [id=bfd54b2eea604e6382f99101a903d9b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:25.311179 24093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.305402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:34629 (local address 127.0.0.1:41410)
0812 00:04:25.305777 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.305786 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.305821 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.306258 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.306259 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.306260 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:25.306299 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.306301 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.308692 (+ 2391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.308693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.309811 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.309814 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.310951 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.310952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.311016 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.311019 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.311074 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.311113 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":2,"thread_start_us":87,"threads_started":1}
I20260812 00:04:25.311208 24098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.305540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41410 (local address 127.25.103.66:34629)
0812 00:04:25.306023 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.306026 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.306036 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:04:25.306075 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.306077 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.306093 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.306175 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:25.307464 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.308591 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.309898 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.310690 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.310943 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.311020 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.311089 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.311132 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":94,"threads_started":1}
I20260812 00:04:25.311401 23979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 098af17d13a44949b30297f864258f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:25.311401 23520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 098af17d13a44949b30297f864258f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:25.311790 23749 tablet_service.cc:1467] Processing CreateTablet for tablet 098af17d13a44949b30297f864258f87 (DEFAULT_TABLE table=test-table [id=bfd54b2eea604e6382f99101a903d9b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:25.312027 23749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 098af17d13a44949b30297f864258f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:25.314622 24102 tablet_bootstrap.cc:492] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09: Bootstrap starting.
I20260812 00:04:25.314949 24103 tablet_bootstrap.cc:492] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5: Bootstrap starting.
I20260812 00:04:25.315003 24106 tablet_bootstrap.cc:492] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d: Bootstrap starting.
I20260812 00:04:25.315483 24102 tablet_bootstrap.cc:654] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:25.315551 24106 tablet_bootstrap.cc:654] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:25.315574 24103 tablet_bootstrap.cc:654] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:25.316056 24106 log.cc:824] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:25.316087 24102 log.cc:824] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:25.316109 24103 log.cc:824] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:25.316897 24103 tablet_bootstrap.cc:492] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5: No bootstrap required, opened a new log
I20260812 00:04:25.317034 24103 ts_tablet_manager.cc:1397] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:04:25.317057 24106 tablet_bootstrap.cc:492] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d: No bootstrap required, opened a new log
I20260812 00:04:25.317116 24106 ts_tablet_manager.cc:1397] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:04:25.317003 24102 tablet_bootstrap.cc:492] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09: No bootstrap required, opened a new log
I20260812 00:04:25.317287 24102 ts_tablet_manager.cc:1397] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:04:25.318634 24106 raft_consensus.cc:348] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740efb21b81d4f1ba3f8970fc103ec09" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34629 } } peers { permanent_uuid: "3642d7e523904bdcb52f22d4befa5ba5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 32931 } } peers { permanent_uuid: "26187cb42eb44ffb8fff5f71961edd0d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43033 } }
I20260812 00:04:25.318792 24106 raft_consensus.cc:374] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:25.318827 24106 raft_consensus.cc:729] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26187cb42eb44ffb8fff5f71961edd0d, State: Initialized, Role: FOLLOWER
I20260812 00:04:25.318953 24106 consensus_queue.cc:260] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740efb21b81d4f1ba3f8970fc103ec09" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34629 } } peers { permanent_uuid: "3642d7e523904bdcb52f22d4befa5ba5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 32931 } } peers { permanent_uuid: "26187cb42eb44ffb8fff5f71961edd0d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43033 } }
I20260812 00:04:25.319067 24103 raft_consensus.cc:348] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740efb21b81d4f1ba3f8970fc103ec09" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34629 } } peers { permanent_uuid: "3642d7e523904bdcb52f22d4befa5ba5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 32931 } } peers { permanent_uuid: "26187cb42eb44ffb8fff5f71961edd0d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43033 } }
I20260812 00:04:25.319227 24106 ts_tablet_manager.cc:1428] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:04:25.319227 24103 raft_consensus.cc:374] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:25.319264 24103 raft_consensus.cc:729] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3642d7e523904bdcb52f22d4befa5ba5, State: Initialized, Role: FOLLOWER
I20260812 00:04:25.319286 23631 heartbeater.cc:503] Master 127.25.103.126:44941 was elected leader, sending a full tablet report...
I20260812 00:04:25.319365 24103 consensus_queue.cc:260] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740efb21b81d4f1ba3f8970fc103ec09" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34629 } } peers { permanent_uuid: "3642d7e523904bdcb52f22d4befa5ba5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 32931 } } peers { permanent_uuid: "26187cb42eb44ffb8fff5f71961edd0d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43033 } }
I20260812 00:04:25.319653 24103 ts_tablet_manager.cc:1428] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:04:25.319679 24078 heartbeater.cc:503] Master 127.25.103.126:44941 was elected leader, sending a full tablet report...
I20260812 00:04:25.319628 24102 raft_consensus.cc:348] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740efb21b81d4f1ba3f8970fc103ec09" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34629 } } peers { permanent_uuid: "3642d7e523904bdcb52f22d4befa5ba5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 32931 } } peers { permanent_uuid: "26187cb42eb44ffb8fff5f71961edd0d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43033 } }
I20260812 00:04:25.320294 24102 raft_consensus.cc:374] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:25.320366 24102 raft_consensus.cc:729] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 740efb21b81d4f1ba3f8970fc103ec09, State: Initialized, Role: FOLLOWER
I20260812 00:04:25.320529 24102 consensus_queue.cc:260] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740efb21b81d4f1ba3f8970fc103ec09" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34629 } } peers { permanent_uuid: "3642d7e523904bdcb52f22d4befa5ba5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 32931 } } peers { permanent_uuid: "26187cb42eb44ffb8fff5f71961edd0d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43033 } }
I20260812 00:04:25.320860 24102 ts_tablet_manager.cc:1428] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260812 00:04:25.320904 23856 heartbeater.cc:503] Master 127.25.103.126:44941 was elected leader, sending a full tablet report...
W20260812 00:04:25.372128 23858 tablet.cc:2369] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:04:25.471465 23632 tablet.cc:2369] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:04:25.497428 24113 raft_consensus.cc:482] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:25.497584 24113 raft_consensus.cc:504] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740efb21b81d4f1ba3f8970fc103ec09" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34629 } } peers { permanent_uuid: "3642d7e523904bdcb52f22d4befa5ba5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 32931 } } peers { permanent_uuid: "26187cb42eb44ffb8fff5f71961edd0d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43033 } }
I20260812 00:04:25.497918 24113 leader_election.cc:288] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 740efb21b81d4f1ba3f8970fc103ec09 (127.25.103.66:34629), 3642d7e523904bdcb52f22d4befa5ba5 (127.25.103.67:32931)
I20260812 00:04:25.500881 24101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.498242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:36831 (local address 127.25.103.67:32931)
0812 00:04:25.498295 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.498298 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.498347 (+ 49us) server_negotiation.cc:407] Connection header received
0812 00:04:25.498415 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.498417 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.498427 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.498481 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:25.498667 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.499150 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.500193 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.500566 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.500631 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.500639 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.500779 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.500816 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:04:25.500880 24098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.498292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:39495 (local address 127.25.103.66:34629)
0812 00:04:25.498348 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.498350 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.498376 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:04:25.498459 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.498460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.498469 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.498521 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:25.498673 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.499153 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.500183 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.500561 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.500623 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.500632 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.500768 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.500804 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 00:04:25.500902 24117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.498136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:34629 (local address 127.25.103.65:39495)
0812 00:04:25.498320 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.498331 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.498394 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.498535 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.498536 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.498538 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:25.498610 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.498612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.499230 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.499231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.500097 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.500099 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.500641 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.500641 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.500706 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.500710 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.500753 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.500796 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":17,"thread_start_us":74,"threads_started":1}
I20260812 00:04:25.500910 24116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.498120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:32931 (local address 127.25.103.65:36831)
0812 00:04:25.498265 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.498278 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.498355 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.498490 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.498490 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.498493 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:25.498595 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.498597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.499227 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.499228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.500099 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.500102 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.500643 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.500644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.500713 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.500716 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.500763 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.500805 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":50,"thread_start_us":97,"threads_started":1}
I20260812 00:04:25.501317 23785 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "098af17d13a44949b30297f864258f87" candidate_uuid: "26187cb42eb44ffb8fff5f71961edd0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "740efb21b81d4f1ba3f8970fc103ec09" is_pre_election: true
I20260812 00:04:25.501473 23785 raft_consensus.cc:2454] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26187cb42eb44ffb8fff5f71961edd0d in term 0.
I20260812 00:04:25.501504 24009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "098af17d13a44949b30297f864258f87" candidate_uuid: "26187cb42eb44ffb8fff5f71961edd0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3642d7e523904bdcb52f22d4befa5ba5" is_pre_election: true
I20260812 00:04:25.501672 24009 raft_consensus.cc:2454] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26187cb42eb44ffb8fff5f71961edd0d in term 0.
I20260812 00:04:25.501744 23448 leader_election.cc:302] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26187cb42eb44ffb8fff5f71961edd0d, 740efb21b81d4f1ba3f8970fc103ec09; no voters:
I20260812 00:04:25.501869 24113 raft_consensus.cc:2781] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:04:25.501926 24113 raft_consensus.cc:482] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:04:25.501971 24113 raft_consensus.cc:3037] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:25.502673 24113 raft_consensus.cc:504] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740efb21b81d4f1ba3f8970fc103ec09" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34629 } } peers { permanent_uuid: "3642d7e523904bdcb52f22d4befa5ba5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 32931 } } peers { permanent_uuid: "26187cb42eb44ffb8fff5f71961edd0d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43033 } }
I20260812 00:04:25.502791 24113 leader_election.cc:288] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [CANDIDATE]: Term 1 election: Requested vote from peers 740efb21b81d4f1ba3f8970fc103ec09 (127.25.103.66:34629), 3642d7e523904bdcb52f22d4befa5ba5 (127.25.103.67:32931)
I20260812 00:04:25.502933 24009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "098af17d13a44949b30297f864258f87" candidate_uuid: "26187cb42eb44ffb8fff5f71961edd0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3642d7e523904bdcb52f22d4befa5ba5"
I20260812 00:04:25.502940 23785 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "098af17d13a44949b30297f864258f87" candidate_uuid: "26187cb42eb44ffb8fff5f71961edd0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "740efb21b81d4f1ba3f8970fc103ec09"
I20260812 00:04:25.503006 23785 raft_consensus.cc:3037] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:25.503008 24009 raft_consensus.cc:3037] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:25.503661 23785 raft_consensus.cc:2454] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26187cb42eb44ffb8fff5f71961edd0d in term 1.
I20260812 00:04:25.503785 24009 raft_consensus.cc:2454] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26187cb42eb44ffb8fff5f71961edd0d in term 1.
I20260812 00:04:25.503810 23448 leader_election.cc:302] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26187cb42eb44ffb8fff5f71961edd0d, 740efb21b81d4f1ba3f8970fc103ec09; no voters:
I20260812 00:04:25.503885 24113 raft_consensus.cc:2781] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:25.504036 24113 raft_consensus.cc:686] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [term 1 LEADER]: Becoming Leader. State: Replica: 26187cb42eb44ffb8fff5f71961edd0d, State: Running, Role: LEADER
I20260812 00:04:25.504122 24113 consensus_queue.cc:237] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740efb21b81d4f1ba3f8970fc103ec09" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34629 } } peers { permanent_uuid: "3642d7e523904bdcb52f22d4befa5ba5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 32931 } } peers { permanent_uuid: "26187cb42eb44ffb8fff5f71961edd0d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43033 } }
I20260812 00:04:25.504933 23322 catalog_manager.cc:5495] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 26187cb42eb44ffb8fff5f71961edd0d (127.25.103.65). New cstate: current_term: 1 leader_uuid: "26187cb42eb44ffb8fff5f71961edd0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740efb21b81d4f1ba3f8970fc103ec09" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3642d7e523904bdcb52f22d4befa5ba5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 32931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26187cb42eb44ffb8fff5f71961edd0d" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43033 } health_report { overall_health: HEALTHY } } }
W20260812 00:04:25.527223 24080 tablet.cc:2369] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:04:25.537261 24100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.534806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43528 (local address 127.25.103.65:43033)
0812 00:04:25.534863 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.534865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.534904 (+ 39us) server_negotiation.cc:407] Connection header received
0812 00:04:25.534951 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.534952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.534975 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.535042 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:04:25.535185 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.535681 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.536454 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.536670 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.536734 (+ 64us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.536908 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:04:25.537010 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:04:25.537101 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.537158 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.537170 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:04:25.539208 23785 raft_consensus.cc:1261] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09 [term 1 FOLLOWER]: Refusing update from remote peer 26187cb42eb44ffb8fff5f71961edd0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:25.539224 24009 raft_consensus.cc:1261] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5 [term 1 FOLLOWER]: Refusing update from remote peer 26187cb42eb44ffb8fff5f71961edd0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:25.539562 24113 consensus_queue.cc:1035] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3642d7e523904bdcb52f22d4befa5ba5" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 32931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:25.539708 24118 consensus_queue.cc:1035] T 098af17d13a44949b30297f864258f87 P 26187cb42eb44ffb8fff5f71961edd0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "740efb21b81d4f1ba3f8970fc103ec09" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 34629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:25.542562 24123 mvcc.cc:205] Tried to move back new op lower bound from 7317475596445876224 to 7317475596305461248. Current Snapshot: MvccSnapshot[applied={T|T < 7317475596445876224}]
I20260812 00:04:25.542706 24126 mvcc.cc:205] Tried to move back new op lower bound from 7317475596445876224 to 7317475596305461248. Current Snapshot: MvccSnapshot[applied={T|T < 7317475596445876224}]
I20260812 00:04:25.542831 24125 mvcc.cc:205] Tried to move back new op lower bound from 7317475596445876224 to 7317475596305461248. Current Snapshot: MvccSnapshot[applied={T|T < 7317475596445876224}]
I20260812 00:04:25.545642 23323 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39124:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:25.545744 23323 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39124:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:25.546569 23323 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3b2be8d87aa44b13a54822c9929f3cb0: Sending DeleteTablet for 3 replicas of tablet 098af17d13a44949b30297f864258f87
I20260812 00:04:25.546965 23520 tablet_service.cc:1514] Processing DeleteTablet for tablet 098af17d13a44949b30297f864258f87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:25 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:43520
I20260812 00:04:25.546994 23979 tablet_service.cc:1514] Processing DeleteTablet for tablet 098af17d13a44949b30297f864258f87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:25 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:55086
I20260812 00:04:25.546994 23749 tablet_service.cc:1514] Processing DeleteTablet for tablet 098af17d13a44949b30297f864258f87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:25 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:41410
I20260812 00:04:25.547309 24141 tablet_replica.cc:330] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09: stopping tablet replica
I20260812 00:04:25.547416 24141 raft_consensus.cc:2229] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:04:25.547528 24141 raft_consensus.cc:2258] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:25.547627 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 23419
I20260812 00:04:25.548094 24141 ts_tablet_manager.cc:1905] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:04:25.549609 24141 ts_tablet_manager.cc:1918] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:25.549777 24141 log.cc:1196] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/098af17d13a44949b30297f864258f87
I20260812 00:04:25.550233 24141 ts_tablet_manager.cc:1939] T 098af17d13a44949b30297f864258f87 P 740efb21b81d4f1ba3f8970fc103ec09: Deleting consensus metadata
I20260812 00:04:25.550815 23296 catalog_manager.cc:4841] TS 740efb21b81d4f1ba3f8970fc103ec09 (127.25.103.66:34629): tablet 098af17d13a44949b30297f864258f87 (table test-table [id=bfd54b2eea604e6382f99101a903d9b1]) successfully deleted
I20260812 00:04:25.551041 24142 tablet_replica.cc:330] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5: stopping tablet replica
I20260812 00:04:25.551173 24142 raft_consensus.cc:2229] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:04:25.551283 24142 raft_consensus.cc:2258] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:25.551723 24142 ts_tablet_manager.cc:1905] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:04:25.553000 24142 ts_tablet_manager.cc:1918] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:25.553071 24142 log.cc:1196] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/098af17d13a44949b30297f864258f87
I20260812 00:04:25.553278 24142 ts_tablet_manager.cc:1939] T 098af17d13a44949b30297f864258f87 P 3642d7e523904bdcb52f22d4befa5ba5: Deleting consensus metadata
I20260812 00:04:25.553618 23299 catalog_manager.cc:4841] TS 3642d7e523904bdcb52f22d4befa5ba5 (127.25.103.67:32931): tablet 098af17d13a44949b30297f864258f87 (table test-table [id=bfd54b2eea604e6382f99101a903d9b1]) successfully deleted
W20260812 00:04:25.559324 23299 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.103.65:43033 (error 108)
I20260812 00:04:25.559507 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 23636
I20260812 00:04:25.563089 24093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.559696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:43033 (local address 127.0.0.1:43540)
0812 00:04:25.562987 (+ 3291us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.563047 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:43033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3261}
W20260812 00:04:25.563345 23299 catalog_manager.cc:4584] TS 26187cb42eb44ffb8fff5f71961edd0d (127.25.103.65:43033): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 098af17d13a44949b30297f864258f87: Network error: Client connection negotiation failed: client connection to 127.25.103.65:43033: connect: Connection refused (error 111)
I20260812 00:04:25.567329 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 23864
I20260812 00:04:25.581033 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 23274
2026-08-12T00:04:25Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2206 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T00:04:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:25Z Disabled control of system clock
I20260812 00:04:25.620160 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:43663
--webserver_interface=127.25.103.126
--webserver_port=0
--builtin_ntp_servers=127.25.103.84:46399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:43663
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:04:25.701849 24153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:25.702178 24153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:25.702209 24153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:25.703415 24153 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:25.703461 24153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:25.703473 24153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:25.703485 24153 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:25.703495 24153 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:25.704941 24153 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:46399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:43663
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:43663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:25.705206 24153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:25.705502 24153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:25.710255 24159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:25.710285 24160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:25.710318 24167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:25.710549 24153 server_base.cc:1034] running on GCE node
I20260812 00:04:25.710789 24153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:25.711118 24153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:25.712271 24153 hybrid_clock.cc:648] HybridClock initialized: now 1786493065712235 us; error 49 us; skew 500 ppm
I20260812 00:04:25.713579 24153 webserver.cc:460] Webserver started at http://127.25.103.126:44337/ using document root <none> and password file <none>
I20260812 00:04:25.713840 24153 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:25.713893 24153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:25.714056 24153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:25.715142 24153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "2b7c8ab6899341d1a66a8992afd084e4"
format_stamp: "Formatted at 2026-08-12 00:04:25 on dist-test-slave-vpvm"
server_key: "dbc7245988ca63dcd391793c08bbb796"
server_key_iv: "6c8a14cbc579ee0eee590623f0495648"
server_key_version: "encryptionkey@0"
I20260812 00:04:25.715495 24153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "2b7c8ab6899341d1a66a8992afd084e4"
format_stamp: "Formatted at 2026-08-12 00:04:25 on dist-test-slave-vpvm"
server_key: "dbc7245988ca63dcd391793c08bbb796"
server_key_iv: "6c8a14cbc579ee0eee590623f0495648"
server_key_version: "encryptionkey@0"
I20260812 00:04:25.716898 24153 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:04:25.717707 24175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.717895 24153 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:25.718010 24153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "2b7c8ab6899341d1a66a8992afd084e4"
format_stamp: "Formatted at 2026-08-12 00:04:25 on dist-test-slave-vpvm"
server_key: "dbc7245988ca63dcd391793c08bbb796"
server_key_iv: "6c8a14cbc579ee0eee590623f0495648"
server_key_version: "encryptionkey@0"
I20260812 00:04:25.718081 24153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:25.733283 24153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:25.733632 24153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:25.733770 24153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:25.737840 24153 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:43663
I20260812 00:04:25.737869 24264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:43663 every 8 connection(s)
I20260812 00:04:25.738255 24153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:25.739243 24265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:25.741562 24265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4: Bootstrap starting.
I20260812 00:04:25.742179 24265 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:25.742449 24265 log.cc:824] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:25.743103 24265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4: No bootstrap required, opened a new log
I20260812 00:04:25.744880 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 24153
I20260812 00:04:25.744755 24265 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b7c8ab6899341d1a66a8992afd084e4" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 43663 } }
I20260812 00:04:25.744933 24265 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:25.744968 24265 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b7c8ab6899341d1a66a8992afd084e4, State: Initialized, Role: FOLLOWER
I20260812 00:04:25.744987 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:25.745123 24265 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b7c8ab6899341d1a66a8992afd084e4" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 43663 } }
I20260812 00:04:25.745180 26013 external_mini_cluster.cc:1428] Setting key f1ed0e73a2e049f6f9bb531622919dbc
I20260812 00:04:25.745205 24265 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:25.745242 24265 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:25.745288 24265 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:25.745939 24265 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b7c8ab6899341d1a66a8992afd084e4" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 43663 } }
I20260812 00:04:25.746074 24265 leader_election.cc:302] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b7c8ab6899341d1a66a8992afd084e4; no voters:
I20260812 00:04:25.746245 24265 leader_election.cc:288] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:25.746277 24275 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:25.746450 24275 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4 [term 1 LEADER]: Becoming Leader. State: Replica: 2b7c8ab6899341d1a66a8992afd084e4, State: Running, Role: LEADER
I20260812 00:04:25.746502 24265 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:25.746608 24275 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b7c8ab6899341d1a66a8992afd084e4" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 43663 } }
I20260812 00:04:25.747078 24277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b7c8ab6899341d1a66a8992afd084e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b7c8ab6899341d1a66a8992afd084e4" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 43663 } } }
I20260812 00:04:25.747160 24277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:25.747373 24278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b7c8ab6899341d1a66a8992afd084e4. Latest consensus state: current_term: 1 leader_uuid: "2b7c8ab6899341d1a66a8992afd084e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b7c8ab6899341d1a66a8992afd084e4" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 43663 } } }
I20260812 00:04:25.747475 24278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:25.747889 24288 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:25.748543 24288 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:25.750566 24288 catalog_manager.cc:1347] Generated new cluster ID: 29388546ecf44af99d09311a1a205755
I20260812 00:04:25.750618 24288 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:25.751654 24273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.745689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38600 (local address 127.25.103.126:43663)
0812 00:04:25.745934 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.745943 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.746016 (+ 73us) server_negotiation.cc:407] Connection header received
0812 00:04:25.746135 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.746143 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.746225 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.746408 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:25.746653 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.748431 (+ 1778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.749419 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.750011 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.750124 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.750983 (+ 859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:25.750987 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:25.750987 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:25.751177 (+ 190us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:25.751217 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:25.751231 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:25.751291 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.751375 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.751448 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":109,"threads_started":1}
I20260812 00:04:25.775597 24288 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:25.776388 24288 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:25.779125 24288 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4: Generated new TSK 0
I20260812 00:04:25.779300 24288 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:25.781919 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:43663
--builtin_ntp_servers=127.25.103.84:46399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:04:25.864142 24307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:25.864367 24307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:25.864388 24307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:25.865533 24307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:25.865578 24307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:25.865603 24307 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:04:25.866993 24307 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:46399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:43663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:25.867223 24307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:25.867529 24307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:25.872502 24332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:25.872510 24327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:25.872522 24326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:25.872579 24307 server_base.cc:1034] running on GCE node
I20260812 00:04:25.872866 24307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:25.873121 24307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:25.874251 24307 hybrid_clock.cc:648] HybridClock initialized: now 1786493065874242 us; error 28 us; skew 500 ppm
I20260812 00:04:25.875450 24307 webserver.cc:460] Webserver started at http://127.25.103.65:45987/ using document root <none> and password file <none>
I20260812 00:04:25.875669 24307 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:25.875712 24307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:25.875821 24307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:25.876874 24307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "5e0260a029ae47bdaa98651e512df330"
format_stamp: "Formatted at 2026-08-12 00:04:25 on dist-test-slave-vpvm"
server_key: "fa064dae280c84efa1b9f000b82c4a5e"
server_key_iv: "68ca5b6d5d8ff091cc7809b1a8f03979"
server_key_version: "encryptionkey@0"
I20260812 00:04:25.877213 24307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "5e0260a029ae47bdaa98651e512df330"
format_stamp: "Formatted at 2026-08-12 00:04:25 on dist-test-slave-vpvm"
server_key: "fa064dae280c84efa1b9f000b82c4a5e"
server_key_iv: "68ca5b6d5d8ff091cc7809b1a8f03979"
server_key_version: "encryptionkey@0"
I20260812 00:04:25.878484 24307 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:04:25.879251 24343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.879437 24307 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:25.879541 24307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "5e0260a029ae47bdaa98651e512df330"
format_stamp: "Formatted at 2026-08-12 00:04:25 on dist-test-slave-vpvm"
server_key: "fa064dae280c84efa1b9f000b82c4a5e"
server_key_iv: "68ca5b6d5d8ff091cc7809b1a8f03979"
server_key_version: "encryptionkey@0"
I20260812 00:04:25.879611 24307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:25.898756 24307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:25.899077 24307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:25.899196 24307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:25.899435 24307 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:25.899798 24307 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:25.899847 24307 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.899878 24307 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:25.899893 24307 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.905685 24307 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:45365
I20260812 00:04:25.905761 24527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:45365 every 8 connection(s)
I20260812 00:04:25.906090 24307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:04:25.907677 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 24307
I20260812 00:04:25.907778 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:04:25.907958 26013 external_mini_cluster.cc:1428] Setting key d02c67840226aec58b93da2a92066074
I20260812 00:04:25.908911 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:43663
--builtin_ntp_servers=127.25.103.84:46399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:04:25.911554 24273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.906866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:44927 (local address 127.25.103.126:43663)
0812 00:04:25.906921 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.906923 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.907173 (+ 250us) server_negotiation.cc:407] Connection header received
0812 00:04:25.907723 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.907725 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.907740 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.907799 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:25.908507 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.909207 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.910207 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.910420 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.910477 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.911289 (+ 812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:25.911291 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:25.911291 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:25.911296 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:25.911312 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:25.911316 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:25.911360 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.911434 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.911471 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:04:25.911794 24533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.906854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:43663 (local address 127.25.103.65:44927)
0812 00:04:25.907060 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.907095 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.907620 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.907872 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.907875 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.907889 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:25.908422 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.908428 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.909299 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.909300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.910128 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.910131 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.910488 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.910489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.910622 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.911160 (+ 538us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:04:25.911160 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:25.911188 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:04:25.911211 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:25.911370 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:25.911375 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:25.911378 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.911439 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.911551 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":99,"threads_started":1}
I20260812 00:04:25.912348 24529 heartbeater.cc:347] Connected to a master server at 127.25.103.126:43663
I20260812 00:04:25.912436 24529 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:25.912617 24529 heartbeater.cc:511] Master 127.25.103.126:43663 requested a full tablet report, sending...
I20260812 00:04:25.913184 24206 ts_manager.cc:194] Registered new tserver with Master: 5e0260a029ae47bdaa98651e512df330 (127.25.103.65:45365)
I20260812 00:04:25.914101 24206 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.103.65:44927
W20260812 00:04:25.992754 24534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:25.992949 24534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:25.992969 24534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:25.994079 24534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:25.994118 24534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:25.994143 24534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:04:25.995446 24534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:46399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:43663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:25.995653 24534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:25.995908 24534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:26.000703 24542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:26.000677 24547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:26.000818 24534 server_base.cc:1034] running on GCE node
W20260812 00:04:26.000670 24545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:26.001041 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:26.001243 24534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:26.002379 24534 hybrid_clock.cc:648] HybridClock initialized: now 1786493066002362 us; error 33 us; skew 500 ppm
I20260812 00:04:26.003571 24534 webserver.cc:460] Webserver started at http://127.25.103.66:42449/ using document root <none> and password file <none>
I20260812 00:04:26.003780 24534 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:26.003819 24534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:26.003911 24534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:26.004904 24534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "68699b243f6f45ab91e952695a78a03c"
format_stamp: "Formatted at 2026-08-12 00:04:25 on dist-test-slave-vpvm"
server_key: "bd47174d6f078c68167b7b4ef5354b6e"
server_key_iv: "58e2a3fc6e2652c6be48f173316be583"
server_key_version: "encryptionkey@0"
I20260812 00:04:26.005195 24534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "68699b243f6f45ab91e952695a78a03c"
format_stamp: "Formatted at 2026-08-12 00:04:25 on dist-test-slave-vpvm"
server_key: "bd47174d6f078c68167b7b4ef5354b6e"
server_key_iv: "58e2a3fc6e2652c6be48f173316be583"
server_key_version: "encryptionkey@0"
I20260812 00:04:26.006358 24534 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:04:26.007009 24564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:26.007179 24534 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:26.007257 24534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "68699b243f6f45ab91e952695a78a03c"
format_stamp: "Formatted at 2026-08-12 00:04:25 on dist-test-slave-vpvm"
server_key: "bd47174d6f078c68167b7b4ef5354b6e"
server_key_iv: "58e2a3fc6e2652c6be48f173316be583"
server_key_version: "encryptionkey@0"
I20260812 00:04:26.007311 24534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:26.030791 24534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:26.031083 24534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:26.031186 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:26.031376 24534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:26.031665 24534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:26.031694 24534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:26.031716 24534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:26.031733 24534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:26.037256 24534 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:41175
I20260812 00:04:26.037339 24733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:41175 every 8 connection(s)
I20260812 00:04:26.037652 24534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:04:26.042979 24273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.038450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:37099 (local address 127.25.103.126:43663)
0812 00:04:26.038507 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:26.038509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:26.038691 (+ 182us) server_negotiation.cc:407] Connection header received
0812 00:04:26.039176 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:26.039177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:26.039186 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:26.039248 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:26.039991 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.040509 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.041589 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.041796 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.041860 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.042745 (+ 885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:26.042747 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:26.042747 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:26.042752 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:26.042767 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:26.042771 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:26.042822 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:26.042882 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 00:04:26.042914 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:04:26.043195 24737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.038383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:43663 (local address 127.25.103.66:37099)
0812 00:04:26.038585 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.038625 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:26.039099 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:26.039360 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:26.039364 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:26.039373 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:26.039897 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:26.039902 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.040601 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.040602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:26.041417 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:26.041420 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.041888 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.041889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:26.042056 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.042603 (+ 547us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:04:26.042604 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:26.042632 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:04:26.042656 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:26.042825 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:26.042828 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:26.042830 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:04:26.042874 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:04:26.042962 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":77,"threads_started":1}
I20260812 00:04:26.043704 24735 heartbeater.cc:347] Connected to a master server at 127.25.103.126:43663
I20260812 00:04:26.043798 24735 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:26.043963 24735 heartbeater.cc:511] Master 127.25.103.126:43663 requested a full tablet report, sending...
I20260812 00:04:26.044327 24206 ts_manager.cc:194] Registered new tserver with Master: 68699b243f6f45ab91e952695a78a03c (127.25.103.66:41175)
I20260812 00:04:26.044703 24206 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.103.66:37099
I20260812 00:04:26.044961 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 24534
I20260812 00:04:26.045068 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:04:26.045257 26013 external_mini_cluster.cc:1428] Setting key 976d3d67452da6423c515164df1f6144
I20260812 00:04:26.046106 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:43663
--builtin_ntp_servers=127.25.103.84:46399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:04:26.128000 24738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:26.128199 24738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:26.128221 24738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:26.129315 24738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:26.129357 24738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:26.129381 24738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:04:26.130733 24738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:46399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:43663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:26.130949 24738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:26.131227 24738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:26.136041 24747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:26.136055 24746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:26.136078 24750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:26.136291 24738 server_base.cc:1034] running on GCE node
I20260812 00:04:26.136495 24738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:26.136721 24738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:26.137874 24738 hybrid_clock.cc:648] HybridClock initialized: now 1786493066137860 us; error 32 us; skew 500 ppm
I20260812 00:04:26.139104 24738 webserver.cc:460] Webserver started at http://127.25.103.67:46647/ using document root <none> and password file <none>
I20260812 00:04:26.139339 24738 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:26.139389 24738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:26.139533 24738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:26.140604 24738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "e8825a40eb334242add5df6aefacddb9"
format_stamp: "Formatted at 2026-08-12 00:04:26 on dist-test-slave-vpvm"
server_key: "b83a2d4768009630e0966367eafde6fa"
server_key_iv: "bf47552727ae094e51b5a3197ee664b0"
server_key_version: "encryptionkey@0"
I20260812 00:04:26.140942 24738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "e8825a40eb334242add5df6aefacddb9"
format_stamp: "Formatted at 2026-08-12 00:04:26 on dist-test-slave-vpvm"
server_key: "b83a2d4768009630e0966367eafde6fa"
server_key_iv: "bf47552727ae094e51b5a3197ee664b0"
server_key_version: "encryptionkey@0"
I20260812 00:04:26.142241 24738 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:04:26.142968 24768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:26.143142 24738 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:26.143226 24738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "e8825a40eb334242add5df6aefacddb9"
format_stamp: "Formatted at 2026-08-12 00:04:26 on dist-test-slave-vpvm"
server_key: "b83a2d4768009630e0966367eafde6fa"
server_key_iv: "bf47552727ae094e51b5a3197ee664b0"
server_key_version: "encryptionkey@0"
I20260812 00:04:26.143287 24738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:26.168948 24738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:26.169257 24738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:26.169394 24738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:26.169641 24738 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:26.170006 24738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:26.170053 24738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:26.170085 24738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:26.170109 24738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:26.175495 24738 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:36189
I20260812 00:04:26.175557 24945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:36189 every 8 connection(s)
I20260812 00:04:26.175850 24738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:04:26.180953 24273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.176584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:52817 (local address 127.25.103.126:43663)
0812 00:04:26.176670 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:26.176672 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:26.176885 (+ 213us) server_negotiation.cc:407] Connection header received
0812 00:04:26.177358 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:26.177359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:26.177370 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:26.177435 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:26.178160 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.178680 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.179695 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.179903 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.179958 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.180738 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:26.180740 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:26.180740 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:26.180744 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:26.180759 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:26.180764 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:26.180803 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:26.180864 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 00:04:26.180890 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 00:04:26.181145 24949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.176558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:43663 (local address 127.25.103.67:52817)
0812 00:04:26.176754 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.176796 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:26.177272 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:26.177504 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:26.177507 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:26.177515 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:26.178058 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:26.178064 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.178753 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.178754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:26.179620 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:26.179623 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.179999 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.180000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:26.180133 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.180606 (+ 473us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:04:26.180607 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:26.180636 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:04:26.180659 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:26.180811 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:26.180813 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:26.180816 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:04:26.180860 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:04:26.180938 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
I20260812 00:04:26.181589 24947 heartbeater.cc:347] Connected to a master server at 127.25.103.126:43663
I20260812 00:04:26.181679 24947 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:26.181860 24947 heartbeater.cc:511] Master 127.25.103.126:43663 requested a full tablet report, sending...
I20260812 00:04:26.182039 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 24738
I20260812 00:04:26.182134 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:04:26.182258 24206 ts_manager.cc:194] Registered new tserver with Master: e8825a40eb334242add5df6aefacddb9 (127.25.103.67:36189)
I20260812 00:04:26.182307 26013 external_mini_cluster.cc:1428] Setting key 9210076d422abc1acabc494dc0d7ccd0
I20260812 00:04:26.182740 24206 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.103.67:52817
I20260812 00:04:26.183172 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:04:26.187351 24273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.184550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38604 (local address 127.25.103.126:43663)
0812 00:04:26.184611 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:26.184613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:26.184680 (+ 67us) server_negotiation.cc:407] Connection header received
0812 00:04:26.184733 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:26.184733 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:26.184744 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:26.184786 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:26.184923 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.185380 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.186197 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.186410 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.186476 (+ 66us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.187097 (+ 621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:26.187098 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:26.187099 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:26.187103 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:26.187118 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:26.187122 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:26.187203 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:26.187258 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 00:04:26.187268 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:04:26.188861 24206 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38604:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:04:26.190351 24206 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:04:26.196403 24971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.192645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36948 (local address 127.25.103.65:45365)
0812 00:04:26.192811 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:26.192815 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:26.193081 (+ 266us) server_negotiation.cc:407] Connection header received
0812 00:04:26.193126 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:26.193128 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:26.193142 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:26.193210 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:26.193391 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.194449 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.195578 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.196072 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.196135 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.196217 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:26.196283 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 00:04:26.196318 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":92,"threads_started":1}
I20260812 00:04:26.196399 24959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.192431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:45365 (local address 127.0.0.1:36948)
0812 00:04:26.192970 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.192978 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:26.193018 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:26.193277 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:26.193277 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:26.193279 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:26.193310 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:26.193311 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.194532 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.194533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:26.195509 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:26.195511 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.196149 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.196150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:26.196211 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.196215 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:04:26.196268 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 00:04:26.196311 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":69,"threads_started":1}
I20260812 00:04:26.196492 24967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.192328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53626 (local address 127.25.103.67:36189)
0812 00:04:26.192523 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:26.192527 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:26.192539 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:04:26.192634 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:26.192637 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:26.192652 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:26.192721 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:26.192871 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.193999 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.195203 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.195884 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.195952 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.196044 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:26.196359 (+ 315us) server_negotiation.cc:299] Negotiation successful
0812 00:04:26.196400 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":88,"threads_started":1}
I20260812 00:04:26.196547 24969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.192264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:41175 (local address 127.0.0.1:51236)
0812 00:04:26.192831 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.192840 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:26.192896 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:26.193122 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:26.193122 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:26.193125 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:26.193169 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:26.193170 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.194066 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.194068 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:26.195301 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:26.195304 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.196265 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.196266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:26.196317 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.196320 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:04:26.196364 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:04:26.196400 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"mutex_wait_us":58,"thread_start_us":102,"threads_started":1}
I20260812 00:04:26.196705 24963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.192240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:36189 (local address 127.0.0.1:53626)
0812 00:04:26.192436 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.192478 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:26.192540 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:26.192735 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:26.192737 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:26.192740 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:26.192806 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:26.192807 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.194090 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.194091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:26.195120 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:26.195122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.196083 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.196084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:26.196161 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.196174 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 00:04:26.196232 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 00:04:26.196285 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":34,"thread_start_us":57,"threads_started":1}
I20260812 00:04:26.196808 24968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.192377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51236 (local address 127.25.103.66:41175)
0812 00:04:26.192647 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:26.192651 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:26.192891 (+ 240us) server_negotiation.cc:407] Connection header received
0812 00:04:26.192962 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:26.192964 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:26.192979 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:26.193052 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:26.193240 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.193987 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.195390 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.196091 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.196153 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.196233 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:26.196438 (+ 205us) server_negotiation.cc:299] Negotiation successful
0812 00:04:26.196588 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":72,"threads_started":1}
I20260812 00:04:26.197474 24635 tablet_service.cc:1467] Processing CreateTablet for tablet 7bda376a0eec45c6b0fdcf25d695760d (DEFAULT_TABLE table=test-table [id=d906d01eec08419da1478836a61674b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:26.197549 24411 tablet_service.cc:1467] Processing CreateTablet for tablet 7bda376a0eec45c6b0fdcf25d695760d (DEFAULT_TABLE table=test-table [id=d906d01eec08419da1478836a61674b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:26.197548 24839 tablet_service.cc:1467] Processing CreateTablet for tablet 7bda376a0eec45c6b0fdcf25d695760d (DEFAULT_TABLE table=test-table [id=d906d01eec08419da1478836a61674b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:26.197779 24635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bda376a0eec45c6b0fdcf25d695760d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:26.197883 24839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bda376a0eec45c6b0fdcf25d695760d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:26.197883 24411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bda376a0eec45c6b0fdcf25d695760d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:26.200341 24972 tablet_bootstrap.cc:492] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c: Bootstrap starting.
I20260812 00:04:26.200953 24972 tablet_bootstrap.cc:654] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:26.201259 24972 log.cc:824] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:26.201371 24974 tablet_bootstrap.cc:492] T 7bda376a0eec45c6b0fdcf25d695760d P 5e0260a029ae47bdaa98651e512df330: Bootstrap starting.
I20260812 00:04:26.201946 24974 tablet_bootstrap.cc:654] T 7bda376a0eec45c6b0fdcf25d695760d P 5e0260a029ae47bdaa98651e512df330: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:26.201095 24973 tablet_bootstrap.cc:492] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9: Bootstrap starting.
I20260812 00:04:26.202033 24972 tablet_bootstrap.cc:492] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c: No bootstrap required, opened a new log
I20260812 00:04:26.202099 24972 ts_tablet_manager.cc:1397] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:04:26.202309 24974 log.cc:824] T 7bda376a0eec45c6b0fdcf25d695760d P 5e0260a029ae47bdaa98651e512df330: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:26.202605 24973 tablet_bootstrap.cc:654] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:26.202899 24973 log.cc:824] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:26.203088 24974 tablet_bootstrap.cc:492] T 7bda376a0eec45c6b0fdcf25d695760d P 5e0260a029ae47bdaa98651e512df330: No bootstrap required, opened a new log
I20260812 00:04:26.203171 24974 ts_tablet_manager.cc:1397] T 7bda376a0eec45c6b0fdcf25d695760d P 5e0260a029ae47bdaa98651e512df330: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:04:26.203718 24973 tablet_bootstrap.cc:492] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9: No bootstrap required, opened a new log
I20260812 00:04:26.203867 24973 ts_tablet_manager.cc:1397] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:04:26.204309 24972 raft_consensus.cc:348] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8825a40eb334242add5df6aefacddb9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36189 } } peers { permanent_uuid: "5e0260a029ae47bdaa98651e512df330" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45365 } } peers { permanent_uuid: "68699b243f6f45ab91e952695a78a03c" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41175 } }
I20260812 00:04:26.204602 24972 raft_consensus.cc:374] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:26.204667 24972 raft_consensus.cc:729] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68699b243f6f45ab91e952695a78a03c, State: Initialized, Role: FOLLOWER
I20260812 00:04:26.204792 24972 consensus_queue.cc:260] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8825a40eb334242add5df6aefacddb9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36189 } } peers { permanent_uuid: "5e0260a029ae47bdaa98651e512df330" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45365 } } peers { permanent_uuid: "68699b243f6f45ab91e952695a78a03c" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41175 } }
I20260812 00:04:26.205044 24972 ts_tablet_manager.cc:1428] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:04:26.205166 24735 heartbeater.cc:503] Master 127.25.103.126:43663 was elected leader, sending a full tablet report...
I20260812 00:04:26.205571 24974 raft_consensus.cc:348] T 7bda376a0eec45c6b0fdcf25d695760d P 5e0260a029ae47bdaa98651e512df330 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8825a40eb334242add5df6aefacddb9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36189 } } peers { permanent_uuid: "5e0260a029ae47bdaa98651e512df330" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45365 } } peers { permanent_uuid: "68699b243f6f45ab91e952695a78a03c" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41175 } }
I20260812 00:04:26.205742 24974 raft_consensus.cc:374] T 7bda376a0eec45c6b0fdcf25d695760d P 5e0260a029ae47bdaa98651e512df330 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:26.205787 24974 raft_consensus.cc:729] T 7bda376a0eec45c6b0fdcf25d695760d P 5e0260a029ae47bdaa98651e512df330 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0260a029ae47bdaa98651e512df330, State: Initialized, Role: FOLLOWER
I20260812 00:04:26.205916 24974 consensus_queue.cc:260] T 7bda376a0eec45c6b0fdcf25d695760d P 5e0260a029ae47bdaa98651e512df330 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8825a40eb334242add5df6aefacddb9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36189 } } peers { permanent_uuid: "5e0260a029ae47bdaa98651e512df330" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45365 } } peers { permanent_uuid: "68699b243f6f45ab91e952695a78a03c" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41175 } }
I20260812 00:04:26.206228 24974 ts_tablet_manager.cc:1428] T 7bda376a0eec45c6b0fdcf25d695760d P 5e0260a029ae47bdaa98651e512df330: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:04:26.206257 24529 heartbeater.cc:503] Master 127.25.103.126:43663 was elected leader, sending a full tablet report...
I20260812 00:04:26.206897 24973 raft_consensus.cc:348] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8825a40eb334242add5df6aefacddb9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36189 } } peers { permanent_uuid: "5e0260a029ae47bdaa98651e512df330" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45365 } } peers { permanent_uuid: "68699b243f6f45ab91e952695a78a03c" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41175 } }
I20260812 00:04:26.207054 24973 raft_consensus.cc:374] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:26.207104 24973 raft_consensus.cc:729] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8825a40eb334242add5df6aefacddb9, State: Initialized, Role: FOLLOWER
I20260812 00:04:26.207208 24973 consensus_queue.cc:260] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8825a40eb334242add5df6aefacddb9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36189 } } peers { permanent_uuid: "5e0260a029ae47bdaa98651e512df330" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45365 } } peers { permanent_uuid: "68699b243f6f45ab91e952695a78a03c" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41175 } }
I20260812 00:04:26.207403 24973 ts_tablet_manager.cc:1428] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:04:26.207530 24947 heartbeater.cc:503] Master 127.25.103.126:43663 was elected leader, sending a full tablet report...
I20260812 00:04:26.209046 24981 raft_consensus.cc:482] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:26.209141 24981 raft_consensus.cc:504] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8825a40eb334242add5df6aefacddb9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36189 } } peers { permanent_uuid: "5e0260a029ae47bdaa98651e512df330" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45365 } } peers { permanent_uuid: "68699b243f6f45ab91e952695a78a03c" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41175 } }
I20260812 00:04:26.209473 24981 leader_election.cc:288] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8825a40eb334242add5df6aefacddb9 (127.25.103.67:36189), 5e0260a029ae47bdaa98651e512df330 (127.25.103.65:45365)
I20260812 00:04:26.213028 24967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.209670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:46653 (local address 127.25.103.67:36189)
0812 00:04:26.209734 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:26.209735 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:26.209931 (+ 196us) server_negotiation.cc:407] Connection header received
0812 00:04:26.210047 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:26.210048 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:26.210057 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:26.210084 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:26.210271 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.210901 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.212350 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.212725 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.212760 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.212767 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:26.212931 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 00:04:26.212969 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 00:04:26.213039 24988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.209636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:36189 (local address 127.25.103.66:46653)
0812 00:04:26.209867 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.209877 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:26.209976 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:26.210147 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:26.210148 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:26.210149 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:26.210215 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:26.210216 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.210974 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.210975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:26.212249 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:26.212253 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.212811 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.212812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:26.212865 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.212867 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:04:26.212917 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 00:04:26.212956 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":2}
I20260812 00:04:26.213116 24971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.209905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:46007 (local address 127.25.103.65:45365)
0812 00:04:26.209998 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:26.210000 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:26.210122 (+ 122us) server_negotiation.cc:407] Connection header received
0812 00:04:26.210147 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:26.210147 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:26.210157 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:26.210203 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:26.210378 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.211039 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.212440 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.212801 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.212862 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.212870 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:26.213018 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 00:04:26.213056 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 00:04:26.213116 24737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.209728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:45365 (local address 127.25.103.66:46007)
0812 00:04:26.210010 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.210021 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:26.210072 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:26.210232 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:26.210233 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:26.210234 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:26.210318 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:26.210319 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.211123 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.211124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:26.212345 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:26.212348 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.212878 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.212879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:26.212959 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.212962 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:04:26.213005 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 00:04:26.213047 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":8,"thread_start_us":92,"threads_started":1}
I20260812 00:04:26.213529 24869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bda376a0eec45c6b0fdcf25d695760d" candidate_uuid: "68699b243f6f45ab91e952695a78a03c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8825a40eb334242add5df6aefacddb9" is_pre_election: true
I20260812 00:04:26.213528 24443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bda376a0eec45c6b0fdcf25d695760d" candidate_uuid: "68699b243f6f45ab91e952695a78a03c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0260a029ae47bdaa98651e512df330" is_pre_election: true
I20260812 00:04:26.213639 24443 raft_consensus.cc:2454] T 7bda376a0eec45c6b0fdcf25d695760d P 5e0260a029ae47bdaa98651e512df330 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68699b243f6f45ab91e952695a78a03c in term 0.
I20260812 00:04:26.213644 24869 raft_consensus.cc:2454] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68699b243f6f45ab91e952695a78a03c in term 0.
I20260812 00:04:26.213848 24567 leader_election.cc:302] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68699b243f6f45ab91e952695a78a03c, e8825a40eb334242add5df6aefacddb9; no voters:
I20260812 00:04:26.213985 24981 raft_consensus.cc:2781] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:04:26.214051 24981 raft_consensus.cc:482] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:04:26.214074 24981 raft_consensus.cc:3037] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:26.214905 24981 raft_consensus.cc:504] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8825a40eb334242add5df6aefacddb9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36189 } } peers { permanent_uuid: "5e0260a029ae47bdaa98651e512df330" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45365 } } peers { permanent_uuid: "68699b243f6f45ab91e952695a78a03c" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41175 } }
I20260812 00:04:26.215044 24981 leader_election.cc:288] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [CANDIDATE]: Term 1 election: Requested vote from peers e8825a40eb334242add5df6aefacddb9 (127.25.103.67:36189), 5e0260a029ae47bdaa98651e512df330 (127.25.103.65:45365)
I20260812 00:04:26.215219 24869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bda376a0eec45c6b0fdcf25d695760d" candidate_uuid: "68699b243f6f45ab91e952695a78a03c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8825a40eb334242add5df6aefacddb9"
I20260812 00:04:26.215240 24443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bda376a0eec45c6b0fdcf25d695760d" candidate_uuid: "68699b243f6f45ab91e952695a78a03c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0260a029ae47bdaa98651e512df330"
I20260812 00:04:26.215287 24869 raft_consensus.cc:3037] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:26.215309 24443 raft_consensus.cc:3037] T 7bda376a0eec45c6b0fdcf25d695760d P 5e0260a029ae47bdaa98651e512df330 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:26.215970 24869 raft_consensus.cc:2454] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68699b243f6f45ab91e952695a78a03c in term 1.
I20260812 00:04:26.216058 24443 raft_consensus.cc:2454] T 7bda376a0eec45c6b0fdcf25d695760d P 5e0260a029ae47bdaa98651e512df330 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68699b243f6f45ab91e952695a78a03c in term 1.
I20260812 00:04:26.216116 24567 leader_election.cc:302] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68699b243f6f45ab91e952695a78a03c, e8825a40eb334242add5df6aefacddb9; no voters:
I20260812 00:04:26.216189 24981 raft_consensus.cc:2781] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:26.216336 24981 raft_consensus.cc:686] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [term 1 LEADER]: Becoming Leader. State: Replica: 68699b243f6f45ab91e952695a78a03c, State: Running, Role: LEADER
I20260812 00:04:26.216419 24981 consensus_queue.cc:237] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8825a40eb334242add5df6aefacddb9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36189 } } peers { permanent_uuid: "5e0260a029ae47bdaa98651e512df330" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45365 } } peers { permanent_uuid: "68699b243f6f45ab91e952695a78a03c" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41175 } }
I20260812 00:04:26.217190 24204 catalog_manager.cc:5495] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c reported cstate change: term changed from 0 to 1, leader changed from <none> to 68699b243f6f45ab91e952695a78a03c (127.25.103.66). New cstate: current_term: 1 leader_uuid: "68699b243f6f45ab91e952695a78a03c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8825a40eb334242add5df6aefacddb9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0260a029ae47bdaa98651e512df330" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68699b243f6f45ab91e952695a78a03c" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 41175 } health_report { overall_health: HEALTHY } } }
I20260812 00:04:26.228296 24968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.226040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51238 (local address 127.25.103.66:41175)
0812 00:04:26.226094 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:26.226096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:26.226106 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:04:26.226179 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:26.226180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:26.226198 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:26.226259 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:04:26.226393 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.226862 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.227595 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.227778 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.227831 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.227968 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:04:26.228056 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:04:26.228142 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:26.228189 (+ 47us) server_negotiation.cc:299] Negotiation successful
0812 00:04:26.228197 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:04:26.230110 24443 raft_consensus.cc:1261] T 7bda376a0eec45c6b0fdcf25d695760d P 5e0260a029ae47bdaa98651e512df330 [term 1 FOLLOWER]: Refusing update from remote peer 68699b243f6f45ab91e952695a78a03c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:26.230118 24869 raft_consensus.cc:1261] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9 [term 1 FOLLOWER]: Refusing update from remote peer 68699b243f6f45ab91e952695a78a03c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:26.230449 24993 consensus_queue.cc:1035] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8825a40eb334242add5df6aefacddb9" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 36189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:26.230573 24981 consensus_queue.cc:1035] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0260a029ae47bdaa98651e512df330" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:26.233300 25002 mvcc.cc:205] Tried to move back new op lower bound from 7317475599275917312 to 7317475599223107584. Current Snapshot: MvccSnapshot[applied={T|T < 7317475599275917312}]
I20260812 00:04:26.233592 24998 mvcc.cc:205] Tried to move back new op lower bound from 7317475599275917312 to 7317475599223107584. Current Snapshot: MvccSnapshot[applied={T|T < 7317475599275917312 or (T in {7317475599275917312})}]
I20260812 00:04:26.234021 25000 mvcc.cc:205] Tried to move back new op lower bound from 7317475599275917312 to 7317475599223107584. Current Snapshot: MvccSnapshot[applied={T|T < 7317475599275917312}]
I20260812 00:04:26.235538 24206 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:26.235639 24206 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:26.236366 24206 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b7c8ab6899341d1a66a8992afd084e4: Sending DeleteTablet for 3 replicas of tablet 7bda376a0eec45c6b0fdcf25d695760d
I20260812 00:04:26.236671 24635 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bda376a0eec45c6b0fdcf25d695760d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:26 UTC) from {username='slave'} at 127.0.0.1:51236
I20260812 00:04:26.236685 24839 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bda376a0eec45c6b0fdcf25d695760d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:26 UTC) from {username='slave'} at 127.0.0.1:53626
I20260812 00:04:26.236768 24411 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bda376a0eec45c6b0fdcf25d695760d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:26 UTC) from {username='slave'} at 127.0.0.1:36948
I20260812 00:04:26.236974 25017 tablet_replica.cc:330] T 7bda376a0eec45c6b0fdcf25d695760d P 5e0260a029ae47bdaa98651e512df330: stopping tablet replica
I20260812 00:04:26.237048 25015 tablet_replica.cc:330] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9: stopping tablet replica
I20260812 00:04:26.237160 25015 raft_consensus.cc:2229] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:04:26.237154 25017 raft_consensus.cc:2229] T 7bda376a0eec45c6b0fdcf25d695760d P 5e0260a029ae47bdaa98651e512df330 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:04:26.237239 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 24307
I20260812 00:04:26.237265 25015 raft_consensus.cc:2258] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:26.255475 25015 ts_tablet_manager.cc:1905] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:04:26.260236 25015 ts_tablet_manager.cc:1918] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:26.260353 25015 log.cc:1196] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/7bda376a0eec45c6b0fdcf25d695760d
I20260812 00:04:26.260681 25015 ts_tablet_manager.cc:1939] T 7bda376a0eec45c6b0fdcf25d695760d P e8825a40eb334242add5df6aefacddb9: Deleting consensus metadata
I20260812 00:04:26.261142 24177 catalog_manager.cc:4841] TS e8825a40eb334242add5df6aefacddb9 (127.25.103.67:36189): tablet 7bda376a0eec45c6b0fdcf25d695760d (table test-table [id=d906d01eec08419da1478836a61674b1]) successfully deleted
W20260812 00:04:26.264950 24177 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.103.65:45365 (error 108)
I20260812 00:04:26.265049 25014 tablet_replica.cc:330] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c: stopping tablet replica
I20260812 00:04:26.265165 25014 raft_consensus.cc:2229] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:04:26.265185 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 24534
I20260812 00:04:26.265271 25014 raft_consensus.cc:2258] T 7bda376a0eec45c6b0fdcf25d695760d P 68699b243f6f45ab91e952695a78a03c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:26.267441 24963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.267195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:45365 (local address 127.0.0.1:36964)
0812 00:04:26.267347 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.267404 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:45365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
W20260812 00:04:26.267947 24177 catalog_manager.cc:4584] TS 5e0260a029ae47bdaa98651e512df330 (127.25.103.65:45365): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7bda376a0eec45c6b0fdcf25d695760d: Network error: Client connection negotiation failed: client connection to 127.25.103.65:45365: connect: Connection refused (error 111)
I20260812 00:04:26.271251 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 24738
I20260812 00:04:26.271263 24963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.271166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:41175 (local address 127.0.0.1:51242)
0812 00:04:26.271219 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.271242 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.66:41175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 00:04:26.282907 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 24153
2026-08-12T00:04:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (699 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:26 dist-test-slave-vpvm krb5kdc[25026](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:26 dist-test-slave-vpvm krb5kdc[25026](info): set up 2 sockets
Aug 12 00:04:26 dist-test-slave-vpvm krb5kdc[25026](info): commencing operation
krb5kdc: starting...
W20260812 00:04:27.452919 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:27 dist-test-slave-vpvm krb5kdc[25026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493067, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:04:27.576785 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:37229
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:37649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:37229
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:27.659659 25050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:27.659884 25050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:27.659906 25050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:27.661005 25050 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:27.661041 25050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:27.661054 25050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:27.661065 25050 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:27.661075 25050 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:27.662621 25050 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:37649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:37229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:37229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:27.662830 25050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:27.663022 25050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:27.668133 25057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:27.668294 25062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:27.668128 25058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:27.668504 25050 server_base.cc:1034] running on GCE node
I20260812 00:04:27.668764 25050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:27.669066 25050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:27.670213 25050 hybrid_clock.cc:648] HybridClock initialized: now 1786493067670194 us; error 29 us; skew 500 ppm
Aug 12 00:04:27 dist-test-slave-vpvm krb5kdc[25026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493067, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:27.672835 25050 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:04:27.673265 25050 webserver.cc:460] Webserver started at http://127.25.103.126:35769/ using document root <none> and password file <none>
I20260812 00:04:27.673496 25050 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:27.673547 25050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:27.673674 25050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:27.674952 25050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "91b3a58188534a139860b26ca5e53433"
format_stamp: "Formatted at 2026-08-12 00:04:27 on dist-test-slave-vpvm"
server_key: "67fdf0e871915aee4e53e46f1b9b1c1b"
server_key_iv: "14846340efb4b2db66fdd0d825a8c7c3"
server_key_version: "encryptionkey@0"
I20260812 00:04:27.675335 25050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "91b3a58188534a139860b26ca5e53433"
format_stamp: "Formatted at 2026-08-12 00:04:27 on dist-test-slave-vpvm"
server_key: "67fdf0e871915aee4e53e46f1b9b1c1b"
server_key_iv: "14846340efb4b2db66fdd0d825a8c7c3"
server_key_version: "encryptionkey@0"
I20260812 00:04:27.676699 25050 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:04:27.677402 25070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:27.677557 25050 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:04:27.677654 25050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "91b3a58188534a139860b26ca5e53433"
format_stamp: "Formatted at 2026-08-12 00:04:27 on dist-test-slave-vpvm"
server_key: "67fdf0e871915aee4e53e46f1b9b1c1b"
server_key_iv: "14846340efb4b2db66fdd0d825a8c7c3"
server_key_version: "encryptionkey@0"
I20260812 00:04:27.677726 25050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:27.690474 25050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:27.692505 25050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:27.692636 25050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:27.696622 25050 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:37229
I20260812 00:04:27.696672 25147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:37229 every 8 connection(s)
I20260812 00:04:27.697027 25050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:27.698064 25148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:27.700414 25148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433: Bootstrap starting.
I20260812 00:04:27.701116 25148 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:27.701388 25148 log.cc:824] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:27.702129 25148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433: No bootstrap required, opened a new log
I20260812 00:04:27.702515 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 25050
I20260812 00:04:27.702628 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:27.702809 26013 external_mini_cluster.cc:1428] Setting key 4dd7dac25bbb70c46479ce4531b13631
I20260812 00:04:27.704540 25148 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91b3a58188534a139860b26ca5e53433" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37229 } }
I20260812 00:04:27.704685 25148 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:27.704720 25148 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91b3a58188534a139860b26ca5e53433, State: Initialized, Role: FOLLOWER
I20260812 00:04:27.704854 25148 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91b3a58188534a139860b26ca5e53433" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37229 } }
I20260812 00:04:27.704917 25148 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:27.704938 25148 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:27.704975 25148 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:27.705497 25148 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91b3a58188534a139860b26ca5e53433" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37229 } }
I20260812 00:04:27.705587 25148 leader_election.cc:302] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91b3a58188534a139860b26ca5e53433; no voters:
I20260812 00:04:27.705744 25148 leader_election.cc:288] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:27.705807 25154 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:27.705927 25154 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433 [term 1 LEADER]: Becoming Leader. State: Replica: 91b3a58188534a139860b26ca5e53433, State: Running, Role: LEADER
I20260812 00:04:27.706048 25148 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:27.706037 25154 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91b3a58188534a139860b26ca5e53433" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37229 } }
I20260812 00:04:27.706364 25154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91b3a58188534a139860b26ca5e53433" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91b3a58188534a139860b26ca5e53433" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37229 } } }
I20260812 00:04:27.706439 25154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:27.706401 25155 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91b3a58188534a139860b26ca5e53433. Latest consensus state: current_term: 1 leader_uuid: "91b3a58188534a139860b26ca5e53433" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91b3a58188534a139860b26ca5e53433" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37229 } } }
I20260812 00:04:27.706609 25155 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:27.706638 25164 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:27.707161 25164 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:27.708678 25164 catalog_manager.cc:1347] Generated new cluster ID: ff4022ffef7f4138a05ceda4a4d83092
I20260812 00:04:27.708730 25164 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:04:27 dist-test-slave-vpvm krb5kdc[25026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493067, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:04:27.714783 25153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:27.703333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46832 (local address 127.25.103.126:37229)
0812 00:04:27.703517 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:27.703525 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:27.703550 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:04:27.704453 (+ 903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:27.704460 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:27.704514 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:27.704640 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:27.705343 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:27.706614 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:27.707664 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:27.708261 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:27.708683 (+ 422us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:27.711258 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:27.711262 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:27.711262 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:27.711273 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:27.713137 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:27.713549 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:27.713552 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:27.713552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:27.713653 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:27.713839 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:27.713840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:27.713840 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:27.714150 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:27.714297 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:27.714419 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 00:04:27.714569 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":92,"threads_started":1}
I20260812 00:04:27.716681 25164 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:27.717206 25164 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:27.720548 25164 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433: Generated new TSK 0
I20260812 00:04:27.720726 25164 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.103.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
Entry for principal kudu/127.25.103.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab.
I20260812 00:04:27.750972 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:37229
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:37649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:27.855595 25190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:27.855805 25190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:27.855829 25190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:27.857028 25190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:27.857081 25190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:27.857120 25190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:04:27.858716 25190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:37649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.65.keytab
--principal=kudu/127.25.103.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:37229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:27.858992 25190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:27.859212 25190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:27.864203 25209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:27.864193 25201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:27.864203 25198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:27.864555 25190 server_base.cc:1034] running on GCE node
I20260812 00:04:27.864763 25190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:27.864995 25190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:27.866137 25190 hybrid_clock.cc:648] HybridClock initialized: now 1786493067866120 us; error 33 us; skew 500 ppm
Aug 12 00:04:27 dist-test-slave-vpvm krb5kdc[25026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493067, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:27.868739 25190 init.cc:377] Logged in from keytab as kudu/127.25.103.65@KRBTEST.COM (short username kudu)
I20260812 00:04:27.869174 25190 webserver.cc:460] Webserver started at http://127.25.103.65:33521/ using document root <none> and password file <none>
I20260812 00:04:27.869395 25190 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:27.869439 25190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:27.869565 25190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:27.870659 25190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "19ae011fb3e64596b427b7ec9ae836ef"
format_stamp: "Formatted at 2026-08-12 00:04:27 on dist-test-slave-vpvm"
server_key: "26312e3a870a32b938a1c5426d6fc825"
server_key_iv: "f6e47c6b288ea2e2c5a485321dfbd6cb"
server_key_version: "encryptionkey@0"
I20260812 00:04:27.870985 25190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "19ae011fb3e64596b427b7ec9ae836ef"
format_stamp: "Formatted at 2026-08-12 00:04:27 on dist-test-slave-vpvm"
server_key: "26312e3a870a32b938a1c5426d6fc825"
server_key_iv: "f6e47c6b288ea2e2c5a485321dfbd6cb"
server_key_version: "encryptionkey@0"
I20260812 00:04:27.872259 25190 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:04:27.873008 25221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:27.873157 25190 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:27.873241 25190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "19ae011fb3e64596b427b7ec9ae836ef"
format_stamp: "Formatted at 2026-08-12 00:04:27 on dist-test-slave-vpvm"
server_key: "26312e3a870a32b938a1c5426d6fc825"
server_key_iv: "f6e47c6b288ea2e2c5a485321dfbd6cb"
server_key_version: "encryptionkey@0"
I20260812 00:04:27.873303 25190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:27.887280 25190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:27.889220 25190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:27.889362 25190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:27.889585 25190 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:27.889884 25190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:27.889918 25190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:27.889977 25190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:27.890005 25190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:27.895643 25190 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:43143
I20260812 00:04:27.895710 25402 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:43143 every 8 connection(s)
I20260812 00:04:27.896013 25190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:04:27.897783 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 25190
I20260812 00:04:27.897899 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:04:27.898108 26013 external_mini_cluster.cc:1428] Setting key 0c1b0410ad201893128bef684745e20f
Aug 12 00:04:27 dist-test-slave-vpvm krb5kdc[25026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493067, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.65@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:04:27.906183 25153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:27.896760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:51635 (local address 127.25.103.126:37229)
0812 00:04:27.896820 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:27.896822 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:27.896992 (+ 170us) server_negotiation.cc:407] Connection header received
0812 00:04:27.897518 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:27.897519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:27.897531 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:27.897618 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:27.898681 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:27.899210 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:27.900594 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:27.900902 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:27.900975 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:27.903431 (+ 2456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:27.903433 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:27.903433 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:27.903440 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:27.904728 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:27.905204 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:27.905205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:27.905205 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:27.905251 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:27.905499 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:27.905499 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:27.905500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:27.905602 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:27.905645 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:27.906029 (+ 384us) server_negotiation.cc:299] Negotiation successful
0812 00:04:27.906113 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:04:27.906509 25408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:27.896708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:37229 (local address 127.25.103.65:51635)
0812 00:04:27.896877 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:27.896914 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:27.897422 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:27.897676 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:27.897680 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:27.898345 (+ 665us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:27.898602 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:27.898608 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:27.899311 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:27.899312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:27.900485 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:27.900490 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:27.900997 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:27.900998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:27.901119 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:27.901634 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:27.901645 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:27.903336 (+ 1691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:27.904817 (+ 1481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:27.904827 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:27.904829 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:27.905133 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:27.905303 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:27.905303 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:27.905304 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:27.905444 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:27.905655 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:27.905661 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:27.905836 (+ 175us) client_negotiation.cc:769] Sending connection context
0812 00:04:27.906018 (+ 182us) client_negotiation.cc:240] Negotiation successful
0812 00:04:27.906205 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":82,"threads_started":1}
I20260812 00:04:27.907075 25405 heartbeater.cc:347] Connected to a master server at 127.25.103.126:37229
I20260812 00:04:27.907188 25405 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:27.907388 25405 heartbeater.cc:511] Master 127.25.103.126:37229 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.25.103.66@KRBTEST.COM; defaulting to no policy
I20260812 00:04:27.907943 25093 ts_manager.cc:194] Registered new tserver with Master: 19ae011fb3e64596b427b7ec9ae836ef (127.25.103.65:43143)
I20260812 00:04:27.908608 25093 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.65@KRBTEST.COM'} at 127.25.103.65:51635
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
Entry for principal kudu/127.25.103.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab.
I20260812 00:04:27.924669 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:37229
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:37649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:28.007074 25411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:28.007325 25411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:28.007352 25411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:28.008528 25411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:28.008571 25411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:28.008596 25411 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:04:28.010097 25411 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:37649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.66.keytab
--principal=kudu/127.25.103.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:37229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25411
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:28.010316 25411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:28.010530 25411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:28.015537 25422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:28.015601 25418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:28.015555 25419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:28.015877 25411 server_base.cc:1034] running on GCE node
I20260812 00:04:28.016076 25411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:28.016294 25411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:28.017454 25411 hybrid_clock.cc:648] HybridClock initialized: now 1786493068017436 us; error 35 us; skew 500 ppm
Aug 12 00:04:28 dist-test-slave-vpvm krb5kdc[25026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493068, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:28.020051 25411 init.cc:377] Logged in from keytab as kudu/127.25.103.66@KRBTEST.COM (short username kudu)
I20260812 00:04:28.020525 25411 webserver.cc:460] Webserver started at http://127.25.103.66:39623/ using document root <none> and password file <none>
I20260812 00:04:28.020754 25411 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:28.020803 25411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:28.020931 25411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:28.022053 25411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "0c3325f7f85f4ed4877c4da0986e7f48"
format_stamp: "Formatted at 2026-08-12 00:04:28 on dist-test-slave-vpvm"
server_key: "b5dc6c3d8026629d2a95c161c6558de3"
server_key_iv: "4b8d01d9d06dc5fd295814017badde02"
server_key_version: "encryptionkey@0"
I20260812 00:04:28.022410 25411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "0c3325f7f85f4ed4877c4da0986e7f48"
format_stamp: "Formatted at 2026-08-12 00:04:28 on dist-test-slave-vpvm"
server_key: "b5dc6c3d8026629d2a95c161c6558de3"
server_key_iv: "4b8d01d9d06dc5fd295814017badde02"
server_key_version: "encryptionkey@0"
I20260812 00:04:28.023773 25411 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:04:28.024546 25437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:28.024760 25411 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:04:28.024843 25411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "0c3325f7f85f4ed4877c4da0986e7f48"
format_stamp: "Formatted at 2026-08-12 00:04:28 on dist-test-slave-vpvm"
server_key: "b5dc6c3d8026629d2a95c161c6558de3"
server_key_iv: "4b8d01d9d06dc5fd295814017badde02"
server_key_version: "encryptionkey@0"
I20260812 00:04:28.024906 25411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:28.042508 25411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:28.044638 25411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:28.044790 25411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:28.045032 25411 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:28.045352 25411 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:28.045390 25411 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:28.045423 25411 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:28.045440 25411 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:28.051314 25411 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:36409
I20260812 00:04:28.051518 25622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:36409 every 8 connection(s)
I20260812 00:04:28.051728 25411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:04:28 dist-test-slave-vpvm krb5kdc[25026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493068, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.66@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:04:28.060715 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 25411
I20260812 00:04:28.060837 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:04:28.060940 25153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.052437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:43643 (local address 127.25.103.126:37229)
0812 00:04:28.052485 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:28.052487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:28.052677 (+ 190us) server_negotiation.cc:407] Connection header received
0812 00:04:28.053202 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:28.053203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:28.053215 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:28.053271 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:28.054228 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.054750 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.055740 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.056005 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.056073 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.058300 (+ 2227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:28.058301 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:28.058301 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:28.058308 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:28.059629 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:28.059985 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:28.059986 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:28.059986 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:28.060032 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:28.060210 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:28.060210 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:28.060210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:28.060311 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:28.060356 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:28.060750 (+ 394us) server_negotiation.cc:299] Negotiation successful
0812 00:04:28.060843 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:04:28.061062 26013 external_mini_cluster.cc:1428] Setting key 9ff64617aa0c48b700bfeb4bec7fa7c9
I20260812 00:04:28.061138 25625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.052407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:37229 (local address 127.25.103.66:43643)
0812 00:04:28.052569 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:28.052606 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:28.053086 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:28.053325 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:28.053328 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:28.053907 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:28.054137 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.054142 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.054840 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.054841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.055656 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.055658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.056101 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.056102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.056209 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.056749 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:28.056757 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:28.058219 (+ 1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:28.059703 (+ 1484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:28.059710 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:28.059712 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:28.059928 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:28.060077 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:28.060077 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:28.060078 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:28.060168 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:28.060386 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:28.060393 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:28.060571 (+ 178us) client_negotiation.cc:769] Sending connection context
0812 00:04:28.060707 (+ 136us) client_negotiation.cc:240] Negotiation successful
0812 00:04:28.060894 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":91,"threads_started":1}
I20260812 00:04:28.061610 25623 heartbeater.cc:347] Connected to a master server at 127.25.103.126:37229
I20260812 00:04:28.061712 25623 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:28.061914 25623 heartbeater.cc:511] Master 127.25.103.126:37229 requested a full tablet report, sending...
I20260812 00:04:28.062342 25091 ts_manager.cc:194] Registered new tserver with Master: 0c3325f7f85f4ed4877c4da0986e7f48 (127.25.103.66:36409)
I20260812 00:04:28.062716 25091 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.66@KRBTEST.COM'} at 127.25.103.66:43643
WARNING: no policy specified for kudu/127.25.103.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
Entry for principal kudu/127.25.103.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab.
I20260812 00:04:28.088274 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:37229
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:37649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:28.171025 25629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:28.171240 25629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:28.171269 25629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:28.172410 25629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:28.172462 25629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:28.172500 25629 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:04:28.173988 25629 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:37649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.67.keytab
--principal=kudu/127.25.103.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:37229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:28.174351 25629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:28.174620 25629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:28.179672 25639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:28.179759 25634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:28.179693 25635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:28.179955 25629 server_base.cc:1034] running on GCE node
I20260812 00:04:28.180181 25629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:28.180420 25629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:28.181566 25629 hybrid_clock.cc:648] HybridClock initialized: now 1786493068181549 us; error 29 us; skew 500 ppm
Aug 12 00:04:28 dist-test-slave-vpvm krb5kdc[25026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493068, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:28.184159 25629 init.cc:377] Logged in from keytab as kudu/127.25.103.67@KRBTEST.COM (short username kudu)
I20260812 00:04:28.184605 25629 webserver.cc:460] Webserver started at http://127.25.103.67:34733/ using document root <none> and password file <none>
I20260812 00:04:28.184828 25629 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:28.184871 25629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:28.184989 25629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:28.186069 25629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "0c3442ef186d4a138f13e0a1f2c2476d"
format_stamp: "Formatted at 2026-08-12 00:04:28 on dist-test-slave-vpvm"
server_key: "375a2720a1f868837116a5064b787f19"
server_key_iv: "86e203b7f18002db8c653f6f5be84b68"
server_key_version: "encryptionkey@0"
I20260812 00:04:28.186446 25629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "0c3442ef186d4a138f13e0a1f2c2476d"
format_stamp: "Formatted at 2026-08-12 00:04:28 on dist-test-slave-vpvm"
server_key: "375a2720a1f868837116a5064b787f19"
server_key_iv: "86e203b7f18002db8c653f6f5be84b68"
server_key_version: "encryptionkey@0"
I20260812 00:04:28.187853 25629 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:04:28.188753 25648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:28.188966 25629 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:28.189069 25629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "0c3442ef186d4a138f13e0a1f2c2476d"
format_stamp: "Formatted at 2026-08-12 00:04:28 on dist-test-slave-vpvm"
server_key: "375a2720a1f868837116a5064b787f19"
server_key_iv: "86e203b7f18002db8c653f6f5be84b68"
server_key_version: "encryptionkey@0"
I20260812 00:04:28.189149 25629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:28.195953 25629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:28.198083 25629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:28.198226 25629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:28.198464 25629 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:28.198774 25629 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:28.198810 25629 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:28.198839 25629 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:28.198858 25629 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:28.204816 25629 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:38161
I20260812 00:04:28.204856 25857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:38161 every 8 connection(s)
I20260812 00:04:28.205190 25629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:04:28 dist-test-slave-vpvm krb5kdc[25026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493068, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.67@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:04:28.214190 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 25629
I20260812 00:04:28.214304 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:04:28.214499 26013 external_mini_cluster.cc:1428] Setting key 1d700d0a8bd242a95b3c8f2c61525533
I20260812 00:04:28.214838 25153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.205990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:37713 (local address 127.25.103.126:37229)
0812 00:04:28.206067 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:28.206069 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:28.206153 (+ 84us) server_negotiation.cc:407] Connection header received
0812 00:04:28.206796 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:28.206798 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:28.206812 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:28.206888 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:28.207911 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.208517 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.209537 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.209744 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.209805 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.212074 (+ 2269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:28.212076 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:28.212076 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:28.212084 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:28.213426 (+ 1342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:28.213831 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:28.213833 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:28.213833 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:28.213890 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:28.214148 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:28.214149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:28.214149 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:28.214281 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:28.214344 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:28.214662 (+ 318us) server_negotiation.cc:299] Negotiation successful
0812 00:04:28.214746 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 00:04:28.215044 25861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.205880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:37229 (local address 127.25.103.67:37713)
0812 00:04:28.206050 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:28.206087 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:28.206650 (+ 563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:28.206946 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:28.206949 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:28.207567 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:28.207810 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.207815 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.208615 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.208616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.209446 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.209448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.209828 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.209829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.209942 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.210493 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:28.210501 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:28.211977 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:28.213534 (+ 1557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:28.213542 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:28.213544 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:28.213765 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:28.213945 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:28.213972 (+ 27us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:28.213973 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:28.214088 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:28.214372 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:28.214379 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:28.214515 (+ 136us) client_negotiation.cc:769] Sending connection context
0812 00:04:28.214622 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 00:04:28.214798 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":88,"threads_started":1}
I20260812 00:04:28.215574 25859 heartbeater.cc:347] Connected to a master server at 127.25.103.126:37229
I20260812 00:04:28.215684 25859 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:28.215862 25859 heartbeater.cc:511] Master 127.25.103.126:37229 requested a full tablet report, sending...
I20260812 00:04:28.216308 25091 ts_manager.cc:194] Registered new tserver with Master: 0c3442ef186d4a138f13e0a1f2c2476d (127.25.103.67:38161)
I20260812 00:04:28.216763 25091 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.103.67@KRBTEST.COM'} at 127.25.103.67:37713
I20260812 00:04:28.226578 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:04:28.234045 25153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.227986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46844 (local address 127.25.103.126:37229)
0812 00:04:28.228071 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:28.228073 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:28.228164 (+ 91us) server_negotiation.cc:407] Connection header received
0812 00:04:28.228192 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:28.228193 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:28.228205 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:28.228254 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:28.228842 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.229428 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.230212 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.230407 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.230488 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.231679 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:28.231680 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:28.231681 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:28.231687 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:28.232943 (+ 1256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:28.233274 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:28.233275 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:28.233276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:28.233338 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:28.233487 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:28.233488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:28.233488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:28.233642 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:28.233775 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:28.233820 (+ 45us) server_negotiation.cc:299] Negotiation successful
0812 00:04:28.233912 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 00:04:28.235816 25091 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46844:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:04:28.237345 25091 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:04:28.243602 25876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.239737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59210 (local address 127.25.103.66:36409)
0812 00:04:28.240018 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:28.240021 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:28.240030 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:04:28.240067 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:28.240069 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:28.240095 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:28.240163 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:28.240358 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.241207 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.242502 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.243209 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.243270 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.243330 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:28.243475 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 00:04:28.243514 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":84,"threads_started":1}
I20260812 00:04:28.243592 25875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.239608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:36409 (local address 127.0.0.1:59210)
0812 00:04:28.239778 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:28.239823 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:28.239890 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:28.240185 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:28.240188 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:28.240190 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:28.240271 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.240273 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.241304 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.241305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.242405 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.242408 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.243278 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.243279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.243371 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.243385 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 00:04:28.243446 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 00:04:28.243513 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":56,"threads_started":1}
I20260812 00:04:28.243742 25874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.239609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:43143 (local address 127.0.0.1:55694)
0812 00:04:28.239994 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:28.240004 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:28.240065 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:28.240305 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:28.240306 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:28.240308 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:28.240365 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.240366 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.241643 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.241644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.242636 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.242639 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.243456 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.243457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.243522 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.243526 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:04:28.243572 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 00:04:28.243612 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"mutex_wait_us":22,"spinlock_wait_cycles":384,"thread_start_us":107,"threads_started":1}
I20260812 00:04:28.243793 25880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.239811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55694 (local address 127.25.103.65:43143)
0812 00:04:28.239980 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:28.239985 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:28.240052 (+ 67us) server_negotiation.cc:407] Connection header received
0812 00:04:28.240129 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:28.240131 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:28.240145 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:28.240214 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:28.240440 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.241522 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.242709 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.243307 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.243372 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.243422 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:28.243657 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 00:04:28.243700 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":90,"threads_started":1}
I20260812 00:04:28.244388 25293 tablet_service.cc:1467] Processing CreateTablet for tablet 7d3a6a19dcee4384b535ba18b7ca1c24 (DEFAULT_TABLE table=test-table [id=c0c439942ee1491b83b1a8a871d3cd7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:28.244388 25516 tablet_service.cc:1467] Processing CreateTablet for tablet 7d3a6a19dcee4384b535ba18b7ca1c24 (DEFAULT_TABLE table=test-table [id=c0c439942ee1491b83b1a8a871d3cd7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:28.244707 25882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.240023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42286 (local address 127.25.103.67:38161)
0812 00:04:28.240385 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:28.240389 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:28.240398 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:04:28.240434 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:28.240436 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:28.240450 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:28.240515 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:28.240723 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.241748 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.243019 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.244221 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.244283 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.244337 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:28.244458 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 00:04:28.244502 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":89,"threads_started":1}
I20260812 00:04:28.244765 25516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d3a6a19dcee4384b535ba18b7ca1c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:28.244765 25293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d3a6a19dcee4384b535ba18b7ca1c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:28.244837 25878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.239807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:38161 (local address 127.0.0.1:42286)
0812 00:04:28.240194 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:28.240203 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:28.240245 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:28.240592 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:28.240593 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:28.240595 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:28.240639 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.240641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.241845 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.241846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.242936 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.242938 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.244312 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.244313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.244377 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.244381 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:04:28.244436 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 00:04:28.244770 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":71,"threads_started":1}
I20260812 00:04:28.246521 25738 tablet_service.cc:1467] Processing CreateTablet for tablet 7d3a6a19dcee4384b535ba18b7ca1c24 (DEFAULT_TABLE table=test-table [id=c0c439942ee1491b83b1a8a871d3cd7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:28.246819 25738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d3a6a19dcee4384b535ba18b7ca1c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:28.248193 25885 tablet_bootstrap.cc:492] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48: Bootstrap starting.
I20260812 00:04:28.248411 25884 tablet_bootstrap.cc:492] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 19ae011fb3e64596b427b7ec9ae836ef: Bootstrap starting.
I20260812 00:04:28.249135 25884 tablet_bootstrap.cc:654] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 19ae011fb3e64596b427b7ec9ae836ef: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:28.249732 25884 log.cc:824] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 19ae011fb3e64596b427b7ec9ae836ef: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:28.249939 25888 tablet_bootstrap.cc:492] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d: Bootstrap starting.
I20260812 00:04:28.250546 25885 tablet_bootstrap.cc:654] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:28.250779 25888 tablet_bootstrap.cc:654] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:28.251297 25885 log.cc:824] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:28.251328 25888 log.cc:824] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:28.252184 25885 tablet_bootstrap.cc:492] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48: No bootstrap required, opened a new log
I20260812 00:04:28.252254 25884 tablet_bootstrap.cc:492] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 19ae011fb3e64596b427b7ec9ae836ef: No bootstrap required, opened a new log
I20260812 00:04:28.252257 25885 ts_tablet_manager.cc:1397] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260812 00:04:28.252315 25884 ts_tablet_manager.cc:1397] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 19ae011fb3e64596b427b7ec9ae836ef: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 00:04:28.254287 25884 raft_consensus.cc:348] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 19ae011fb3e64596b427b7ec9ae836ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c3325f7f85f4ed4877c4da0986e7f48" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 36409 } } peers { permanent_uuid: "0c3442ef186d4a138f13e0a1f2c2476d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38161 } } peers { permanent_uuid: "19ae011fb3e64596b427b7ec9ae836ef" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43143 } }
I20260812 00:04:28.254287 25885 raft_consensus.cc:348] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c3325f7f85f4ed4877c4da0986e7f48" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 36409 } } peers { permanent_uuid: "0c3442ef186d4a138f13e0a1f2c2476d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38161 } } peers { permanent_uuid: "19ae011fb3e64596b427b7ec9ae836ef" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43143 } }
I20260812 00:04:28.254484 25884 raft_consensus.cc:374] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 19ae011fb3e64596b427b7ec9ae836ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:28.254484 25885 raft_consensus.cc:374] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:28.254522 25885 raft_consensus.cc:729] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c3325f7f85f4ed4877c4da0986e7f48, State: Initialized, Role: FOLLOWER
I20260812 00:04:28.254522 25884 raft_consensus.cc:729] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 19ae011fb3e64596b427b7ec9ae836ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19ae011fb3e64596b427b7ec9ae836ef, State: Initialized, Role: FOLLOWER
I20260812 00:04:28.254642 25885 consensus_queue.cc:260] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c3325f7f85f4ed4877c4da0986e7f48" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 36409 } } peers { permanent_uuid: "0c3442ef186d4a138f13e0a1f2c2476d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38161 } } peers { permanent_uuid: "19ae011fb3e64596b427b7ec9ae836ef" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43143 } }
I20260812 00:04:28.254642 25884 consensus_queue.cc:260] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 19ae011fb3e64596b427b7ec9ae836ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c3325f7f85f4ed4877c4da0986e7f48" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 36409 } } peers { permanent_uuid: "0c3442ef186d4a138f13e0a1f2c2476d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38161 } } peers { permanent_uuid: "19ae011fb3e64596b427b7ec9ae836ef" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43143 } }
I20260812 00:04:28.254941 25884 ts_tablet_manager.cc:1428] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 19ae011fb3e64596b427b7ec9ae836ef: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:04:28.255071 25405 heartbeater.cc:503] Master 127.25.103.126:37229 was elected leader, sending a full tablet report...
I20260812 00:04:28.255010 25885 ts_tablet_manager.cc:1428] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:04:28.255553 25623 heartbeater.cc:503] Master 127.25.103.126:37229 was elected leader, sending a full tablet report...
I20260812 00:04:28.255869 25888 tablet_bootstrap.cc:492] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d: No bootstrap required, opened a new log
I20260812 00:04:28.255952 25888 ts_tablet_manager.cc:1397] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260812 00:04:28.257295 25888 raft_consensus.cc:348] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c3325f7f85f4ed4877c4da0986e7f48" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 36409 } } peers { permanent_uuid: "0c3442ef186d4a138f13e0a1f2c2476d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38161 } } peers { permanent_uuid: "19ae011fb3e64596b427b7ec9ae836ef" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43143 } }
I20260812 00:04:28.257437 25888 raft_consensus.cc:374] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:28.257458 25888 raft_consensus.cc:729] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c3442ef186d4a138f13e0a1f2c2476d, State: Initialized, Role: FOLLOWER
I20260812 00:04:28.257560 25888 consensus_queue.cc:260] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c3325f7f85f4ed4877c4da0986e7f48" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 36409 } } peers { permanent_uuid: "0c3442ef186d4a138f13e0a1f2c2476d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38161 } } peers { permanent_uuid: "19ae011fb3e64596b427b7ec9ae836ef" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43143 } }
I20260812 00:04:28.257987 25888 ts_tablet_manager.cc:1428] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:04:28.258011 25859 heartbeater.cc:503] Master 127.25.103.126:37229 was elected leader, sending a full tablet report...
W20260812 00:04:28.302330 25624 tablet.cc:2369] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:04:28.370361 25896 raft_consensus.cc:482] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:28.370517 25896 raft_consensus.cc:504] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c3325f7f85f4ed4877c4da0986e7f48" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 36409 } } peers { permanent_uuid: "0c3442ef186d4a138f13e0a1f2c2476d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38161 } } peers { permanent_uuid: "19ae011fb3e64596b427b7ec9ae836ef" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43143 } }
I20260812 00:04:28.370867 25896 leader_election.cc:288] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c3325f7f85f4ed4877c4da0986e7f48 (127.25.103.66:36409), 19ae011fb3e64596b427b7ec9ae836ef (127.25.103.65:43143)
I20260812 00:04:28.373926 25861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.371067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:36409 (local address 127.25.103.67:50327)
0812 00:04:28.371131 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:28.371142 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:28.371187 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:28.371320 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:28.371321 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:28.371322 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:28.371398 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.371399 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.372028 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.372029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.372831 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.372834 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.373627 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.373629 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.373718 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.373720 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:04:28.373784 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 00:04:28.373829 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":43}
I20260812 00:04:28.373973 25880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.371134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:48567 (local address 127.25.103.65:43143)
0812 00:04:28.371180 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:28.371182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:28.371338 (+ 156us) server_negotiation.cc:407] Connection header received
0812 00:04:28.371385 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:28.371386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:28.371396 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:28.371444 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:28.371590 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.372058 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.372998 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.373548 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.373611 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.373620 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:28.373828 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 00:04:28.373875 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:04:28.373976 25876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.371129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:50327 (local address 127.25.103.66:36409)
0812 00:04:28.371171 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:28.371173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:28.371183 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:04:28.371249 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:28.371250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:28.371260 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:28.371309 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:28.371462 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.371948 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.372933 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.373527 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.373611 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.373620 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:28.373828 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 00:04:28.373874 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:04:28.373936 25897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.371068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:43143 (local address 127.25.103.67:48567)
0812 00:04:28.371258 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:28.371267 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:28.371331 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:28.371455 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:28.371456 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:28.371457 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:28.371532 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.371533 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.372137 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.372138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.372908 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.372910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.373628 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.373629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.373714 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.373719 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:04:28.373784 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 00:04:28.373829 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":19,"thread_start_us":124,"threads_started":1}
I20260812 00:04:28.374341 25319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3a6a19dcee4384b535ba18b7ca1c24" candidate_uuid: "0c3442ef186d4a138f13e0a1f2c2476d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19ae011fb3e64596b427b7ec9ae836ef" is_pre_election: true
I20260812 00:04:28.374401 25555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3a6a19dcee4384b535ba18b7ca1c24" candidate_uuid: "0c3442ef186d4a138f13e0a1f2c2476d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c3325f7f85f4ed4877c4da0986e7f48" is_pre_election: true
I20260812 00:04:28.374532 25319 raft_consensus.cc:2454] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 19ae011fb3e64596b427b7ec9ae836ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c3442ef186d4a138f13e0a1f2c2476d in term 0.
I20260812 00:04:28.374534 25555 raft_consensus.cc:2454] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c3442ef186d4a138f13e0a1f2c2476d in term 0.
I20260812 00:04:28.374748 25649 leader_election.cc:302] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c3442ef186d4a138f13e0a1f2c2476d, 19ae011fb3e64596b427b7ec9ae836ef; no voters:
I20260812 00:04:28.374909 25896 raft_consensus.cc:2781] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:04:28.374951 25896 raft_consensus.cc:482] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:04:28.374967 25896 raft_consensus.cc:3037] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:28.375717 25896 raft_consensus.cc:504] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c3325f7f85f4ed4877c4da0986e7f48" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 36409 } } peers { permanent_uuid: "0c3442ef186d4a138f13e0a1f2c2476d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38161 } } peers { permanent_uuid: "19ae011fb3e64596b427b7ec9ae836ef" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43143 } }
I20260812 00:04:28.375850 25896 leader_election.cc:288] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [CANDIDATE]: Term 1 election: Requested vote from peers 0c3325f7f85f4ed4877c4da0986e7f48 (127.25.103.66:36409), 19ae011fb3e64596b427b7ec9ae836ef (127.25.103.65:43143)
I20260812 00:04:28.376008 25555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3a6a19dcee4384b535ba18b7ca1c24" candidate_uuid: "0c3442ef186d4a138f13e0a1f2c2476d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c3325f7f85f4ed4877c4da0986e7f48"
I20260812 00:04:28.376049 25319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3a6a19dcee4384b535ba18b7ca1c24" candidate_uuid: "0c3442ef186d4a138f13e0a1f2c2476d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19ae011fb3e64596b427b7ec9ae836ef"
I20260812 00:04:28.376088 25555 raft_consensus.cc:3037] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:28.376122 25319 raft_consensus.cc:3037] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 19ae011fb3e64596b427b7ec9ae836ef [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:28.376758 25555 raft_consensus.cc:2454] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c3442ef186d4a138f13e0a1f2c2476d in term 1.
I20260812 00:04:28.376829 25319 raft_consensus.cc:2454] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 19ae011fb3e64596b427b7ec9ae836ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c3442ef186d4a138f13e0a1f2c2476d in term 1.
I20260812 00:04:28.376960 25650 leader_election.cc:302] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c3325f7f85f4ed4877c4da0986e7f48, 0c3442ef186d4a138f13e0a1f2c2476d; no voters:
I20260812 00:04:28.377115 25896 raft_consensus.cc:2781] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:28.377282 25896 raft_consensus.cc:686] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [term 1 LEADER]: Becoming Leader. State: Replica: 0c3442ef186d4a138f13e0a1f2c2476d, State: Running, Role: LEADER
I20260812 00:04:28.377372 25896 consensus_queue.cc:237] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c3325f7f85f4ed4877c4da0986e7f48" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 36409 } } peers { permanent_uuid: "0c3442ef186d4a138f13e0a1f2c2476d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38161 } } peers { permanent_uuid: "19ae011fb3e64596b427b7ec9ae836ef" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43143 } }
I20260812 00:04:28.378208 25090 catalog_manager.cc:5495] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c3442ef186d4a138f13e0a1f2c2476d (127.25.103.67). New cstate: current_term: 1 leader_uuid: "0c3442ef186d4a138f13e0a1f2c2476d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c3325f7f85f4ed4877c4da0986e7f48" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 36409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c3442ef186d4a138f13e0a1f2c2476d" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 38161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19ae011fb3e64596b427b7ec9ae836ef" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43143 } health_report { overall_health: UNKNOWN } } }
I20260812 00:04:28.388324 25882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.386051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42288 (local address 127.25.103.67:38161)
0812 00:04:28.386110 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:28.386112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:28.386120 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:04:28.386152 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:28.386153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:28.386169 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:28.386227 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:04:28.386350 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.386886 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.387613 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.387810 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.387864 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.388004 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:04:28.388112 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:04:28.388186 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:28.388205 (+ 19us) server_negotiation.cc:299] Negotiation successful
0812 00:04:28.388226 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:04:28.390093 25319 raft_consensus.cc:1261] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 19ae011fb3e64596b427b7ec9ae836ef [term 1 FOLLOWER]: Refusing update from remote peer 0c3442ef186d4a138f13e0a1f2c2476d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:28.390092 25555 raft_consensus.cc:1261] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48 [term 1 FOLLOWER]: Refusing update from remote peer 0c3442ef186d4a138f13e0a1f2c2476d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:28.390429 25898 consensus_queue.cc:1035] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c3325f7f85f4ed4877c4da0986e7f48" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 36409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:28.390564 25896 consensus_queue.cc:1035] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [LEADER]: Connected to new peer: Peer: permanent_uuid: "19ae011fb3e64596b427b7ec9ae836ef" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:28.393328 25903 mvcc.cc:205] Tried to move back new op lower bound from 7317475608123240448 to 7317475608074383360. Current Snapshot: MvccSnapshot[applied={T|T < 7317475608123240448}]
I20260812 00:04:28.395403 25090 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:28.395494 25090 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:28.396183 25090 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 91b3a58188534a139860b26ca5e53433: Sending DeleteTablet for 3 replicas of tablet 7d3a6a19dcee4384b535ba18b7ca1c24
I20260812 00:04:28.396517 25293 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3a6a19dcee4384b535ba18b7ca1c24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:28 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:55694
I20260812 00:04:28.396611 25738 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3a6a19dcee4384b535ba18b7ca1c24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:28 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:42286
I20260812 00:04:28.396761 25516 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3a6a19dcee4384b535ba18b7ca1c24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:28 UTC) from {username='kudu', principal='kudu/127.25.103.126@KRBTEST.COM'} at 127.0.0.1:59210
I20260812 00:04:28.396802 25916 tablet_replica.cc:330] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 19ae011fb3e64596b427b7ec9ae836ef: stopping tablet replica
I20260812 00:04:28.396898 25916 raft_consensus.cc:2229] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 19ae011fb3e64596b427b7ec9ae836ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:04:28.397006 25916 raft_consensus.cc:2258] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 19ae011fb3e64596b427b7ec9ae836ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:28.397027 25919 tablet_replica.cc:330] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48: stopping tablet replica
I20260812 00:04:28.397194 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 25190
I20260812 00:04:28.397220 25919 raft_consensus.cc:2229] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:04:28.397398 25919 raft_consensus.cc:2258] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:28.400686 25919 ts_tablet_manager.cc:1905] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:04:28.402750 25919 ts_tablet_manager.cc:1918] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:28.402915 25919 log.cc:1196] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/7d3a6a19dcee4384b535ba18b7ca1c24
I20260812 00:04:28.403337 25919 ts_tablet_manager.cc:1939] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3325f7f85f4ed4877c4da0986e7f48: Deleting consensus metadata
I20260812 00:04:28.403924 25073 catalog_manager.cc:4841] TS 0c3325f7f85f4ed4877c4da0986e7f48 (127.25.103.66:36409): tablet 7d3a6a19dcee4384b535ba18b7ca1c24 (table test-table [id=c0c439942ee1491b83b1a8a871d3cd7f]) successfully deleted
I20260812 00:04:28.404587 25918 tablet_replica.cc:330] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d: stopping tablet replica
I20260812 00:04:28.404719 25918 raft_consensus.cc:2229] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:04:28.404867 25918 raft_consensus.cc:2258] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:28.405332 25918 ts_tablet_manager.cc:1905] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:04:28.406934 25918 ts_tablet_manager.cc:1918] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:28.407011 25918 log.cc:1196] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/7d3a6a19dcee4384b535ba18b7ca1c24
I20260812 00:04:28.407258 25918 ts_tablet_manager.cc:1939] T 7d3a6a19dcee4384b535ba18b7ca1c24 P 0c3442ef186d4a138f13e0a1f2c2476d: Deleting consensus metadata
I20260812 00:04:28.407689 25073 catalog_manager.cc:4841] TS 0c3442ef186d4a138f13e0a1f2c2476d (127.25.103.67:38161): tablet 7d3a6a19dcee4384b535ba18b7ca1c24 (table test-table [id=c0c439942ee1491b83b1a8a871d3cd7f]) successfully deleted
W20260812 00:04:28.409833 25072 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.103.65:43143 (error 108)
I20260812 00:04:28.410408 25878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.410272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:43143 (local address 127.0.0.1:55702)
0812 00:04:28.410329 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:28.410371 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 00:04:28.410498 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 25411
W20260812 00:04:28.417996 25072 catalog_manager.cc:4584] TS 19ae011fb3e64596b427b7ec9ae836ef (127.25.103.65:43143): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7d3a6a19dcee4384b535ba18b7ca1c24: Network error: Client connection negotiation failed: client connection to 127.25.103.65:43143: connect: Connection refused (error 111)
I20260812 00:04:28.424379 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 25629
I20260812 00:04:28.437211 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 25050
2026-08-12T00:04:28Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2152 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T00:04:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:28Z Disabled control of system clock
I20260812 00:04:28.471905 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:36159
--webserver_interface=127.25.103.126
--webserver_port=0
--builtin_ntp_servers=127.25.103.84:37279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:36159
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:04:28.553623 25930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:28.553860 25930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:28.553880 25930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:28.555032 25930 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:28.555074 25930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:28.555086 25930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:28.555097 25930 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:28.555109 25930 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:28.556434 25930 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:37279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:36159
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:36159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:28.556762 25930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:28.557083 25930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:28.562217 25938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:28.562249 25939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:28.562284 25930 server_base.cc:1034] running on GCE node
W20260812 00:04:28.562247 25942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:28.562637 25930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:28.562948 25930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:28.564121 25930 hybrid_clock.cc:648] HybridClock initialized: now 1786493068564103 us; error 32 us; skew 500 ppm
I20260812 00:04:28.565587 25930 webserver.cc:460] Webserver started at http://127.25.103.126:36969/ using document root <none> and password file <none>
I20260812 00:04:28.565838 25930 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:28.565896 25930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:28.566069 25930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:28.567271 25930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "2f6bd437e7f4420f88a1fd0f4b800fd6"
format_stamp: "Formatted at 2026-08-12 00:04:28 on dist-test-slave-vpvm"
server_key: "4e356c7219252c189ea70fd9bb925701"
server_key_iv: "b32c1f57b7930907d0d5985957c2cb80"
server_key_version: "encryptionkey@0"
I20260812 00:04:28.567669 25930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "2f6bd437e7f4420f88a1fd0f4b800fd6"
format_stamp: "Formatted at 2026-08-12 00:04:28 on dist-test-slave-vpvm"
server_key: "4e356c7219252c189ea70fd9bb925701"
server_key_iv: "b32c1f57b7930907d0d5985957c2cb80"
server_key_version: "encryptionkey@0"
I20260812 00:04:28.569095 25930 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:04:28.569883 25954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:28.570056 25930 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:28.570153 25930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "2f6bd437e7f4420f88a1fd0f4b800fd6"
format_stamp: "Formatted at 2026-08-12 00:04:28 on dist-test-slave-vpvm"
server_key: "4e356c7219252c189ea70fd9bb925701"
server_key_iv: "b32c1f57b7930907d0d5985957c2cb80"
server_key_version: "encryptionkey@0"
I20260812 00:04:28.570223 25930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:28.586359 25930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:28.586743 25930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:28.586889 25930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:28.591023 25930 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:36159
I20260812 00:04:28.591073 26036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:36159 every 8 connection(s)
I20260812 00:04:28.591421 25930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:28.592417 26040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:28.594830 26040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6: Bootstrap starting.
I20260812 00:04:28.595417 26040 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:28.595662 26040 log.cc:824] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:28.596354 26040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6: No bootstrap required, opened a new log
I20260812 00:04:28.596909 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 25930
I20260812 00:04:28.597009 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:28.597173 26013 external_mini_cluster.cc:1428] Setting key 641f4658330f0632b48d25f391b87d2b
I20260812 00:04:28.598429 26040 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f6bd437e7f4420f88a1fd0f4b800fd6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36159 } }
I20260812 00:04:28.598618 26040 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:28.598670 26040 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6bd437e7f4420f88a1fd0f4b800fd6, State: Initialized, Role: FOLLOWER
I20260812 00:04:28.598814 26040 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f6bd437e7f4420f88a1fd0f4b800fd6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36159 } }
I20260812 00:04:28.598903 26040 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:28.598942 26040 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:28.598992 26040 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:28.599761 26040 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f6bd437e7f4420f88a1fd0f4b800fd6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36159 } }
I20260812 00:04:28.599880 26040 leader_election.cc:302] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f6bd437e7f4420f88a1fd0f4b800fd6; no voters:
I20260812 00:04:28.600063 26040 leader_election.cc:288] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:28.600107 26048 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:28.600261 26048 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 2f6bd437e7f4420f88a1fd0f4b800fd6, State: Running, Role: LEADER
I20260812 00:04:28.600323 26040 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:28.600359 26048 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f6bd437e7f4420f88a1fd0f4b800fd6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36159 } }
I20260812 00:04:28.600718 26048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f6bd437e7f4420f88a1fd0f4b800fd6. Latest consensus state: current_term: 1 leader_uuid: "2f6bd437e7f4420f88a1fd0f4b800fd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f6bd437e7f4420f88a1fd0f4b800fd6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36159 } } }
I20260812 00:04:28.600795 26048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:28.601583 26058 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:28.601775 26051 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f6bd437e7f4420f88a1fd0f4b800fd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f6bd437e7f4420f88a1fd0f4b800fd6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36159 } } }
I20260812 00:04:28.602097 26058 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:28.602111 26051 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:28.603825 26058 catalog_manager.cc:1347] Generated new cluster ID: 6cce3cfc690c4491888f83e0e71b06c9
I20260812 00:04:28.603858 26045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.597716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35744 (local address 127.25.103.126:36159)
0812 00:04:28.597977 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:28.597987 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:28.598025 (+ 38us) server_negotiation.cc:407] Connection header received
0812 00:04:28.598396 (+ 371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:28.598405 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:28.598488 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:28.598652 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:28.598885 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.600633 (+ 1748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.601669 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.602307 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.602427 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.603140 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:28.603144 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:28.603144 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:28.603347 (+ 203us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:28.603393 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:28.603409 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:28.603476 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:28.603565 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 00:04:28.603648 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":96,"threads_started":1}
I20260812 00:04:28.603883 26058 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:28.612226 26058 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:28.612939 26058 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:28.618875 26058 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6: Generated new TSK 0
I20260812 00:04:28.619100 26058 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:28.624922 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.65:0
--local_ip_for_outbound_sockets=127.25.103.65
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:36159
--builtin_ntp_servers=127.25.103.84:37279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:04:28.708701 26078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:28.708918 26078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:28.708943 26078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:28.710214 26078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:28.710263 26078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:28.710289 26078 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.65
I20260812 00:04:28.711715 26078 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:37279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.103.65
--webserver_port=0
--tserver_master_addrs=127.25.103.126:36159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.65
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:28.711956 26078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:28.712268 26078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:28.717316 26084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:28.717341 26085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:28.717391 26087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:28.717680 26078 server_base.cc:1034] running on GCE node
I20260812 00:04:28.717902 26078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:28.718204 26078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:28.719393 26078 hybrid_clock.cc:648] HybridClock initialized: now 1786493068719371 us; error 35 us; skew 500 ppm
I20260812 00:04:28.720837 26078 webserver.cc:460] Webserver started at http://127.25.103.65:40533/ using document root <none> and password file <none>
I20260812 00:04:28.721130 26078 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:28.721187 26078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:28.721315 26078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:28.722708 26078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-0/data/instance:
uuid: "e83547efebb5479b9f2be4d8056244ff"
format_stamp: "Formatted at 2026-08-12 00:04:28 on dist-test-slave-vpvm"
server_key: "a3c50ac8dadc033975afeef5d008e029"
server_key_iv: "da689b4dae8447a11ab4508e6288bd35"
server_key_version: "encryptionkey@0"
I20260812 00:04:28.723093 26078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance:
uuid: "e83547efebb5479b9f2be4d8056244ff"
format_stamp: "Formatted at 2026-08-12 00:04:28 on dist-test-slave-vpvm"
server_key: "a3c50ac8dadc033975afeef5d008e029"
server_key_iv: "da689b4dae8447a11ab4508e6288bd35"
server_key_version: "encryptionkey@0"
I20260812 00:04:28.724697 26078 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:04:28.725601 26098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:28.725768 26078 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:28.725862 26078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-0/wal
uuid: "e83547efebb5479b9f2be4d8056244ff"
format_stamp: "Formatted at 2026-08-12 00:04:28 on dist-test-slave-vpvm"
server_key: "a3c50ac8dadc033975afeef5d008e029"
server_key_iv: "da689b4dae8447a11ab4508e6288bd35"
server_key_version: "encryptionkey@0"
I20260812 00:04:28.725936 26078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:28.749431 26078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:28.749732 26078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:28.749837 26078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:28.750077 26078 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:28.750384 26078 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:28.750415 26078 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:28.750437 26078 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:28.750448 26078 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:28.755988 26078 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.65:46693
I20260812 00:04:28.756057 26280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.65:46693 every 8 connection(s)
I20260812 00:04:28.756366 26078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-0/data/info.pb
I20260812 00:04:28.760798 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 26078
I20260812 00:04:28.760895 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-0/wal/instance
I20260812 00:04:28.761103 26013 external_mini_cluster.cc:1428] Setting key 89ef20e2f0f629135f85c4dffa22ca03
I20260812 00:04:28.761657 26045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.757078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.65:60751 (local address 127.25.103.126:36159)
0812 00:04:28.757137 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:28.757139 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:28.757359 (+ 220us) server_negotiation.cc:407] Connection header received
0812 00:04:28.757856 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:28.757857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:28.757868 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:28.757930 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:28.758701 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.759211 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.760232 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.760441 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.760503 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.761379 (+ 876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:28.761381 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:28.761381 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:28.761387 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:28.761410 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:28.761414 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:28.761471 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:28.761573 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 00:04:28.761598 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:04:28.762079 26287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.757053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:36159 (local address 127.25.103.65:60751)
0812 00:04:28.757251 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:28.757289 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:28.757770 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:28.758004 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:28.758008 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:28.758016 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:28.758610 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.758617 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.759310 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.759311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.760124 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.760126 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.760532 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.760533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.760661 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.761225 (+ 564us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:04:28.761225 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:28.761255 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:04:28.761282 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:28.761496 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:28.761503 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:28.761505 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:04:28.761569 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 00:04:28.761685 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":77,"threads_started":1}
I20260812 00:04:28.762148 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.66:0
--local_ip_for_outbound_sockets=127.25.103.66
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:36159
--builtin_ntp_servers=127.25.103.84:37279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:04:28.762671 26282 heartbeater.cc:347] Connected to a master server at 127.25.103.126:36159
I20260812 00:04:28.762768 26282 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:28.762944 26282 heartbeater.cc:511] Master 127.25.103.126:36159 requested a full tablet report, sending...
I20260812 00:04:28.763453 25980 ts_manager.cc:194] Registered new tserver with Master: e83547efebb5479b9f2be4d8056244ff (127.25.103.65:46693)
I20260812 00:04:28.764329 25980 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.103.65:60751
W20260812 00:04:28.846066 26289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:28.846290 26289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:28.846324 26289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:28.847484 26289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:28.847532 26289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:28.847570 26289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.66
I20260812 00:04:28.848945 26289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:37279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.103.66
--webserver_port=0
--tserver_master_addrs=127.25.103.126:36159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.66
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:28.849210 26289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:28.849536 26289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:28.854627 26303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:28.854696 26289 server_base.cc:1034] running on GCE node
W20260812 00:04:28.854635 26299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:28.854650 26297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:28.855026 26289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:28.855283 26289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:28.856446 26289 hybrid_clock.cc:648] HybridClock initialized: now 1786493068856433 us; error 30 us; skew 500 ppm
I20260812 00:04:28.857659 26289 webserver.cc:460] Webserver started at http://127.25.103.66:46079/ using document root <none> and password file <none>
I20260812 00:04:28.857929 26289 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:28.858018 26289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:28.858165 26289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:28.859248 26289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-1/data/instance:
uuid: "efa6e64f5fd544668a00147f445753c5"
format_stamp: "Formatted at 2026-08-12 00:04:28 on dist-test-slave-vpvm"
server_key: "b9809a6411136d98903ec02d2c8f6465"
server_key_iv: "8b6c17e721bc88404ed233434eb00730"
server_key_version: "encryptionkey@0"
I20260812 00:04:28.859586 26289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance:
uuid: "efa6e64f5fd544668a00147f445753c5"
format_stamp: "Formatted at 2026-08-12 00:04:28 on dist-test-slave-vpvm"
server_key: "b9809a6411136d98903ec02d2c8f6465"
server_key_iv: "8b6c17e721bc88404ed233434eb00730"
server_key_version: "encryptionkey@0"
I20260812 00:04:28.860865 26289 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:04:28.861577 26311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:28.861730 26289 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:28.861812 26289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-1/wal
uuid: "efa6e64f5fd544668a00147f445753c5"
format_stamp: "Formatted at 2026-08-12 00:04:28 on dist-test-slave-vpvm"
server_key: "b9809a6411136d98903ec02d2c8f6465"
server_key_iv: "8b6c17e721bc88404ed233434eb00730"
server_key_version: "encryptionkey@0"
I20260812 00:04:28.861884 26289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:28.894390 26289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:28.894718 26289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:28.894853 26289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:28.895089 26289 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:28.895427 26289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:28.895462 26289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:28.895485 26289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:28.895496 26289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:28.901405 26289 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.66:43007
I20260812 00:04:28.901523 26490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.66:43007 every 8 connection(s)
I20260812 00:04:28.901798 26289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-1/data/info.pb
I20260812 00:04:28.906922 26045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.902551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.66:48943 (local address 127.25.103.126:36159)
0812 00:04:28.902616 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:28.902619 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:28.902825 (+ 206us) server_negotiation.cc:407] Connection header received
0812 00:04:28.903331 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:28.903332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:28.903346 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:28.903381 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:28.904046 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.904560 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.905603 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.905805 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.905859 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.906702 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:28.906703 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:28.906703 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:28.906708 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:28.906721 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:28.906725 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:28.906765 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:28.906821 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 00:04:28.906849 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:04:28.907100 26494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.902527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:36159 (local address 127.25.103.66:48943)
0812 00:04:28.902711 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:28.902746 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:28.903241 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:28.903446 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:28.903449 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:28.903458 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:28.903968 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.903973 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.904673 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.904674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.905513 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.905515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.905873 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.905873 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.906027 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.906571 (+ 544us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:04:28.906572 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:28.906602 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:04:28.906626 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:28.906768 (+ 142us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:28.906770 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:28.906772 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:04:28.906817 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 00:04:28.906907 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
I20260812 00:04:28.907581 26491 heartbeater.cc:347] Connected to a master server at 127.25.103.126:36159
I20260812 00:04:28.907678 26491 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:28.907857 26491 heartbeater.cc:511] Master 127.25.103.126:36159 requested a full tablet report, sending...
I20260812 00:04:28.908255 25980 ts_manager.cc:194] Registered new tserver with Master: efa6e64f5fd544668a00147f445753c5 (127.25.103.66:43007)
I20260812 00:04:28.908623 25980 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.103.66:48943
I20260812 00:04:28.908761 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 26289
I20260812 00:04:28.908865 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-1/wal/instance
I20260812 00:04:28.909060 26013 external_mini_cluster.cc:1428] Setting key 93aab04e3b3947b2ba14ea0706a54e4f
I20260812 00:04:28.909864 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.103.67:0
--local_ip_for_outbound_sockets=127.25.103.67
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:36159
--builtin_ntp_servers=127.25.103.84:37279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:04:28.992177 26495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:28.992399 26495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:28.992422 26495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:28.993537 26495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:28.993571 26495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:28.993594 26495 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.103.67
I20260812 00:04:28.994952 26495 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:37279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.103.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.103.67
--webserver_port=0
--tserver_master_addrs=127.25.103.126:36159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.103.67
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:28.995178 26495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:28.995446 26495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:29.000660 26510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:29.000751 26495 server_base.cc:1034] running on GCE node
W20260812 00:04:29.000757 26506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:29.000835 26508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:29.001068 26495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:29.001336 26495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:29.002483 26495 hybrid_clock.cc:648] HybridClock initialized: now 1786493069002466 us; error 32 us; skew 500 ppm
I20260812 00:04:29.003750 26495 webserver.cc:460] Webserver started at http://127.25.103.67:37467/ using document root <none> and password file <none>
I20260812 00:04:29.004004 26495 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:29.004055 26495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:29.004179 26495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:29.005326 26495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-2/data/instance:
uuid: "c45e6f4ae7b54e2e8ab94945ffdd0d73"
format_stamp: "Formatted at 2026-08-12 00:04:28 on dist-test-slave-vpvm"
server_key: "9359a66583666612b3d66f6ab08bea79"
server_key_iv: "16cb8858d51930660a3d06018af04655"
server_key_version: "encryptionkey@0"
I20260812 00:04:29.005672 26495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance:
uuid: "c45e6f4ae7b54e2e8ab94945ffdd0d73"
format_stamp: "Formatted at 2026-08-12 00:04:28 on dist-test-slave-vpvm"
server_key: "9359a66583666612b3d66f6ab08bea79"
server_key_iv: "16cb8858d51930660a3d06018af04655"
server_key_version: "encryptionkey@0"
I20260812 00:04:29.006945 26495 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:04:29.007678 26519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:29.007836 26495 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:04:29.007921 26495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-2/wal
uuid: "c45e6f4ae7b54e2e8ab94945ffdd0d73"
format_stamp: "Formatted at 2026-08-12 00:04:28 on dist-test-slave-vpvm"
server_key: "9359a66583666612b3d66f6ab08bea79"
server_key_iv: "16cb8858d51930660a3d06018af04655"
server_key_version: "encryptionkey@0"
I20260812 00:04:29.008064 26495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:29.021859 26495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:29.022226 26495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:29.022367 26495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:29.022609 26495 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:29.022939 26495 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:29.022976 26495 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:29.023008 26495 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:29.023031 26495 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:29.028853 26495 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.67:34629
I20260812 00:04:29.028898 26707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.67:34629 every 8 connection(s)
I20260812 00:04:29.029228 26495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-2/data/info.pb
I20260812 00:04:29.034420 26045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:29.030040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:58387 (local address 127.25.103.126:36159)
0812 00:04:29.030099 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:29.030101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:29.030333 (+ 232us) server_negotiation.cc:407] Connection header received
0812 00:04:29.030889 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:29.030891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:29.030902 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:29.030969 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:29.031628 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.032125 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.033130 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.033321 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.033373 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:29.034176 (+ 803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:29.034177 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:29.034177 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:29.034182 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:29.034198 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:29.034202 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:29.034243 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:29.034324 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 00:04:29.034350 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 00:04:29.034618 26713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:29.030033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:36159 (local address 127.25.103.67:58387)
0812 00:04:29.030208 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:29.030248 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:29.030770 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:29.031021 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:29.031025 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:29.031033 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:29.031544 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:29.031548 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.032226 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.032227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:29.033050 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:29.033053 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.033402 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.033403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:29.033535 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:29.034048 (+ 513us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:04:29.034048 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:29.034078 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:04:29.034099 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:29.034250 (+ 151us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:29.034253 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:29.034255 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:04:29.034304 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 00:04:29.034396 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":69,"threads_started":1}
I20260812 00:04:29.035066 26708 heartbeater.cc:347] Connected to a master server at 127.25.103.126:36159
I20260812 00:04:29.035152 26708 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:29.035326 26708 heartbeater.cc:511] Master 127.25.103.126:36159 requested a full tablet report, sending...
I20260812 00:04:29.035715 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 26495
I20260812 00:04:29.035791 25980 ts_manager.cc:194] Registered new tserver with Master: c45e6f4ae7b54e2e8ab94945ffdd0d73 (127.25.103.67:34629)
I20260812 00:04:29.035830 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-2/wal/instance
I20260812 00:04:29.036011 26013 external_mini_cluster.cc:1428] Setting key b9738c4fa94c4c3899fc45409aa1c053
I20260812 00:04:29.036231 25980 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.103.67:58387
I20260812 00:04:29.036985 26013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:04:29.040987 26045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:29.038383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52668 (local address 127.25.103.126:36159)
0812 00:04:29.038427 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:29.038429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:29.038513 (+ 84us) server_negotiation.cc:407] Connection header received
0812 00:04:29.038562 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:29.038563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:29.038571 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:29.038620 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:29.038733 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.039193 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.039961 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.040155 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.040204 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:29.040799 (+ 595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:29.040800 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:29.040801 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:29.040805 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:29.040818 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:29.040822 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:29.040860 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:29.040898 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 00:04:29.040918 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:04:29.042689 25979 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52668:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:04:29.044209 25979 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:04:29.051043 26730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:29.046823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53642 (local address 127.25.103.65:46693)
0812 00:04:29.046981 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:29.046986 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:29.046995 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:04:29.047034 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:29.047036 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:29.047051 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:29.047170 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:29.047375 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.048533 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.049829 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.050629 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.050703 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:29.050800 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:29.050911 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 00:04:29.050952 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":93,"threads_started":1}
I20260812 00:04:29.051034 26725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:29.046577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:46693 (local address 127.0.0.1:53642)
0812 00:04:29.046814 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:29.046822 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:29.046860 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:29.047209 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:29.047210 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:29.047212 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:29.047293 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:29.047296 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.048614 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.048615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:29.049749 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:29.049752 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.050717 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.050718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:29.050796 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:29.050810 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 00:04:29.050885 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 00:04:29.050942 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"mutex_wait_us":64,"thread_start_us":79,"threads_started":1}
I20260812 00:04:29.051203 26724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:29.046542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45066 (local address 127.25.103.66:43007)
0812 00:04:29.047431 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:29.047435 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:29.047444 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:04:29.047480 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:29.047481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:29.047495 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:29.047568 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:29.047676 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.048365 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.049874 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.050633 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.050703 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:29.050800 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:29.051080 (+ 280us) server_negotiation.cc:299] Negotiation successful
0812 00:04:29.051124 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":847,"thread_start_us":85,"threads_started":1}
I20260812 00:04:29.051667 26723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:29.046357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.67:34629 (local address 127.0.0.1:43880)
0812 00:04:29.046584 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:29.046627 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:29.046693 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:29.047181 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:29.047185 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:29.047188 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:29.047276 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:29.047278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.049549 (+ 2271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.049550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:29.050371 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:29.050373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.051430 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.051432 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:29.051498 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:29.051503 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:04:29.051556 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 00:04:29.051597 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":2,"thread_start_us":80,"threads_started":1}
I20260812 00:04:29.051689 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:29.046543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43880 (local address 127.25.103.67:34629)
0812 00:04:29.046864 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:29.046869 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:29.046879 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:04:29.046920 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:29.046922 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:29.046938 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:29.047026 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:29.047345 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.048518 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.050447 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.051327 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.051408 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:29.051496 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:29.051569 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 00:04:29.051606 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":116,"threads_started":1}
I20260812 00:04:29.052121 26719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:29.046398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:43007 (local address 127.0.0.1:45066)
0812 00:04:29.046759 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:29.046769 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:29.046820 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:29.047580 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:29.047581 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:29.047583 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:29.047620 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:29.047621 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.048442 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.048443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:29.049795 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:29.049797 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.050838 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.050839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:29.050910 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:29.050917 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 00:04:29.050964 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 00:04:29.051007 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":33,"thread_start_us":105,"threads_started":1}
I20260812 00:04:29.052493 26599 tablet_service.cc:1467] Processing CreateTablet for tablet 39fb6161808b400f9509f6147a8a8dbd (DEFAULT_TABLE table=test-table [id=dcc717cf7b7f4a7381a0f73c8578ef72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:29.052358 26171 tablet_service.cc:1467] Processing CreateTablet for tablet 39fb6161808b400f9509f6147a8a8dbd (DEFAULT_TABLE table=test-table [id=dcc717cf7b7f4a7381a0f73c8578ef72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:29.052845 26599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39fb6161808b400f9509f6147a8a8dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:29.052851 26171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39fb6161808b400f9509f6147a8a8dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:29.052819 26387 tablet_service.cc:1467] Processing CreateTablet for tablet 39fb6161808b400f9509f6147a8a8dbd (DEFAULT_TABLE table=test-table [id=dcc717cf7b7f4a7381a0f73c8578ef72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:29.053148 26387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39fb6161808b400f9509f6147a8a8dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:29.055470 26731 tablet_bootstrap.cc:492] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73: Bootstrap starting.
I20260812 00:04:29.056151 26731 tablet_bootstrap.cc:654] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:29.056315 26736 tablet_bootstrap.cc:492] T 39fb6161808b400f9509f6147a8a8dbd P e83547efebb5479b9f2be4d8056244ff: Bootstrap starting.
I20260812 00:04:29.056838 26731 log.cc:824] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:29.057013 26736 tablet_bootstrap.cc:654] T 39fb6161808b400f9509f6147a8a8dbd P e83547efebb5479b9f2be4d8056244ff: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:29.057264 26734 tablet_bootstrap.cc:492] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5: Bootstrap starting.
I20260812 00:04:29.057332 26736 log.cc:824] T 39fb6161808b400f9509f6147a8a8dbd P e83547efebb5479b9f2be4d8056244ff: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:29.057906 26734 tablet_bootstrap.cc:654] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:29.058221 26736 tablet_bootstrap.cc:492] T 39fb6161808b400f9509f6147a8a8dbd P e83547efebb5479b9f2be4d8056244ff: No bootstrap required, opened a new log
I20260812 00:04:29.058259 26734 log.cc:824] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:29.058302 26736 ts_tablet_manager.cc:1397] T 39fb6161808b400f9509f6147a8a8dbd P e83547efebb5479b9f2be4d8056244ff: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:04:29.058517 26731 tablet_bootstrap.cc:492] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73: No bootstrap required, opened a new log
I20260812 00:04:29.058610 26731 ts_tablet_manager.cc:1397] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 00:04:29.059052 26734 tablet_bootstrap.cc:492] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5: No bootstrap required, opened a new log
I20260812 00:04:29.059129 26734 ts_tablet_manager.cc:1397] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:04:29.060765 26731 raft_consensus.cc:348] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45e6f4ae7b54e2e8ab94945ffdd0d73" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34629 } } peers { permanent_uuid: "e83547efebb5479b9f2be4d8056244ff" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46693 } } peers { permanent_uuid: "efa6e64f5fd544668a00147f445753c5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43007 } }
I20260812 00:04:29.060930 26731 raft_consensus.cc:374] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:29.060966 26731 raft_consensus.cc:729] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45e6f4ae7b54e2e8ab94945ffdd0d73, State: Initialized, Role: FOLLOWER
I20260812 00:04:29.060942 26736 raft_consensus.cc:348] T 39fb6161808b400f9509f6147a8a8dbd P e83547efebb5479b9f2be4d8056244ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45e6f4ae7b54e2e8ab94945ffdd0d73" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34629 } } peers { permanent_uuid: "e83547efebb5479b9f2be4d8056244ff" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46693 } } peers { permanent_uuid: "efa6e64f5fd544668a00147f445753c5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43007 } }
I20260812 00:04:29.061124 26736 raft_consensus.cc:374] T 39fb6161808b400f9509f6147a8a8dbd P e83547efebb5479b9f2be4d8056244ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:29.061124 26731 consensus_queue.cc:260] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45e6f4ae7b54e2e8ab94945ffdd0d73" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34629 } } peers { permanent_uuid: "e83547efebb5479b9f2be4d8056244ff" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46693 } } peers { permanent_uuid: "efa6e64f5fd544668a00147f445753c5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43007 } }
I20260812 00:04:29.061170 26736 raft_consensus.cc:729] T 39fb6161808b400f9509f6147a8a8dbd P e83547efebb5479b9f2be4d8056244ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83547efebb5479b9f2be4d8056244ff, State: Initialized, Role: FOLLOWER
I20260812 00:04:29.061291 26736 consensus_queue.cc:260] T 39fb6161808b400f9509f6147a8a8dbd P e83547efebb5479b9f2be4d8056244ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45e6f4ae7b54e2e8ab94945ffdd0d73" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34629 } } peers { permanent_uuid: "e83547efebb5479b9f2be4d8056244ff" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46693 } } peers { permanent_uuid: "efa6e64f5fd544668a00147f445753c5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43007 } }
I20260812 00:04:29.061448 26731 ts_tablet_manager.cc:1428] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:04:29.061553 26708 heartbeater.cc:503] Master 127.25.103.126:36159 was elected leader, sending a full tablet report...
I20260812 00:04:29.061642 26734 raft_consensus.cc:348] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45e6f4ae7b54e2e8ab94945ffdd0d73" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34629 } } peers { permanent_uuid: "e83547efebb5479b9f2be4d8056244ff" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46693 } } peers { permanent_uuid: "efa6e64f5fd544668a00147f445753c5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43007 } }
I20260812 00:04:29.061798 26734 raft_consensus.cc:374] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:29.061841 26734 raft_consensus.cc:729] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efa6e64f5fd544668a00147f445753c5, State: Initialized, Role: FOLLOWER
I20260812 00:04:29.061928 26736 ts_tablet_manager.cc:1428] T 39fb6161808b400f9509f6147a8a8dbd P e83547efebb5479b9f2be4d8056244ff: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260812 00:04:29.061998 26734 consensus_queue.cc:260] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45e6f4ae7b54e2e8ab94945ffdd0d73" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34629 } } peers { permanent_uuid: "e83547efebb5479b9f2be4d8056244ff" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46693 } } peers { permanent_uuid: "efa6e64f5fd544668a00147f445753c5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43007 } }
I20260812 00:04:29.062098 26282 heartbeater.cc:503] Master 127.25.103.126:36159 was elected leader, sending a full tablet report...
I20260812 00:04:29.062273 26734 ts_tablet_manager.cc:1428] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 00:04:29.062299 26491 heartbeater.cc:503] Master 127.25.103.126:36159 was elected leader, sending a full tablet report...
W20260812 00:04:29.152372 26492 tablet.cc:2369] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:04:29.159597 26743 raft_consensus.cc:482] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:29.159721 26743 raft_consensus.cc:504] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45e6f4ae7b54e2e8ab94945ffdd0d73" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34629 } } peers { permanent_uuid: "e83547efebb5479b9f2be4d8056244ff" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46693 } } peers { permanent_uuid: "efa6e64f5fd544668a00147f445753c5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43007 } }
I20260812 00:04:29.160064 26743 leader_election.cc:288] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e83547efebb5479b9f2be4d8056244ff (127.25.103.65:46693), efa6e64f5fd544668a00147f445753c5 (127.25.103.66:43007)
I20260812 00:04:29.162907 26730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:29.160314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:53407 (local address 127.25.103.65:46693)
0812 00:04:29.160357 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:29.160359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:29.160483 (+ 124us) server_negotiation.cc:407] Connection header received
0812 00:04:29.160533 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:29.160534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:29.160546 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:29.160602 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:29.160778 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.161262 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.162216 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.162583 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.162646 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:29.162655 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:29.162788 (+ 133us) server_negotiation.cc:299] Negotiation successful
0812 00:04:29.162830 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:04:29.162917 26724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:29.160310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.103.67:35905 (local address 127.25.103.66:43007)
0812 00:04:29.160357 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:29.160359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:29.160371 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:04:29.160408 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:29.160409 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:29.160420 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:29.160484 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:29.160658 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.161165 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.162232 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.162587 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.162651 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:29.162659 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:29.162806 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 00:04:29.162846 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:04:29.162928 26713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:29.160240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.66:43007 (local address 127.25.103.67:35905)
0812 00:04:29.160300 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:29.160311 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:29.160356 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:29.160505 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:29.160505 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:29.160507 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:29.160591 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:29.160593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.161271 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.161272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:29.162139 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:29.162141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.162660 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.162661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:29.162741 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:29.162744 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:04:29.162795 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:04:29.162837 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":21}
I20260812 00:04:29.162950 26746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:29.160261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:46693 (local address 127.25.103.67:53407)
0812 00:04:29.160420 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:29.160429 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:29.160482 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:29.160610 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:29.160610 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:29.160611 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:29.160682 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:29.160683 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.161345 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.161345 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:29.162133 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:29.162136 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.162659 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.162660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:29.162727 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:29.162731 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:04:29.162771 (+ 40us) client_negotiation.cc:240] Negotiation successful
0812 00:04:29.162814 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":2,"thread_start_us":93,"threads_started":1}
I20260812 00:04:29.163321 26200 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39fb6161808b400f9509f6147a8a8dbd" candidate_uuid: "c45e6f4ae7b54e2e8ab94945ffdd0d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83547efebb5479b9f2be4d8056244ff" is_pre_election: true
I20260812 00:04:29.163321 26423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39fb6161808b400f9509f6147a8a8dbd" candidate_uuid: "c45e6f4ae7b54e2e8ab94945ffdd0d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efa6e64f5fd544668a00147f445753c5" is_pre_election: true
I20260812 00:04:29.163501 26200 raft_consensus.cc:2454] T 39fb6161808b400f9509f6147a8a8dbd P e83547efebb5479b9f2be4d8056244ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45e6f4ae7b54e2e8ab94945ffdd0d73 in term 0.
I20260812 00:04:29.163522 26423 raft_consensus.cc:2454] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45e6f4ae7b54e2e8ab94945ffdd0d73 in term 0.
I20260812 00:04:29.163837 26523 leader_election.cc:302] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: c45e6f4ae7b54e2e8ab94945ffdd0d73, e83547efebb5479b9f2be4d8056244ff, efa6e64f5fd544668a00147f445753c5; no voters:
I20260812 00:04:29.164029 26743 raft_consensus.cc:2781] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:04:29.164108 26743 raft_consensus.cc:482] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:04:29.164135 26743 raft_consensus.cc:3037] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:29.164912 26743 raft_consensus.cc:504] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45e6f4ae7b54e2e8ab94945ffdd0d73" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34629 } } peers { permanent_uuid: "e83547efebb5479b9f2be4d8056244ff" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46693 } } peers { permanent_uuid: "efa6e64f5fd544668a00147f445753c5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43007 } }
I20260812 00:04:29.165048 26743 leader_election.cc:288] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [CANDIDATE]: Term 1 election: Requested vote from peers e83547efebb5479b9f2be4d8056244ff (127.25.103.65:46693), efa6e64f5fd544668a00147f445753c5 (127.25.103.66:43007)
I20260812 00:04:29.165203 26423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39fb6161808b400f9509f6147a8a8dbd" candidate_uuid: "c45e6f4ae7b54e2e8ab94945ffdd0d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efa6e64f5fd544668a00147f445753c5"
I20260812 00:04:29.165225 26200 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39fb6161808b400f9509f6147a8a8dbd" candidate_uuid: "c45e6f4ae7b54e2e8ab94945ffdd0d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83547efebb5479b9f2be4d8056244ff"
I20260812 00:04:29.165279 26423 raft_consensus.cc:3037] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:29.165299 26200 raft_consensus.cc:3037] T 39fb6161808b400f9509f6147a8a8dbd P e83547efebb5479b9f2be4d8056244ff [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:29.166046 26423 raft_consensus.cc:2454] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45e6f4ae7b54e2e8ab94945ffdd0d73 in term 1.
I20260812 00:04:29.166146 26200 raft_consensus.cc:2454] T 39fb6161808b400f9509f6147a8a8dbd P e83547efebb5479b9f2be4d8056244ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45e6f4ae7b54e2e8ab94945ffdd0d73 in term 1.
I20260812 00:04:29.166246 26526 leader_election.cc:302] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45e6f4ae7b54e2e8ab94945ffdd0d73, efa6e64f5fd544668a00147f445753c5; no voters:
I20260812 00:04:29.166332 26743 raft_consensus.cc:2781] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:29.166484 26743 raft_consensus.cc:686] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [term 1 LEADER]: Becoming Leader. State: Replica: c45e6f4ae7b54e2e8ab94945ffdd0d73, State: Running, Role: LEADER
I20260812 00:04:29.166585 26743 consensus_queue.cc:237] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45e6f4ae7b54e2e8ab94945ffdd0d73" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34629 } } peers { permanent_uuid: "e83547efebb5479b9f2be4d8056244ff" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46693 } } peers { permanent_uuid: "efa6e64f5fd544668a00147f445753c5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43007 } }
I20260812 00:04:29.167402 25979 catalog_manager.cc:5495] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 reported cstate change: term changed from 0 to 1, leader changed from <none> to c45e6f4ae7b54e2e8ab94945ffdd0d73 (127.25.103.67). New cstate: current_term: 1 leader_uuid: "c45e6f4ae7b54e2e8ab94945ffdd0d73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45e6f4ae7b54e2e8ab94945ffdd0d73" member_type: VOTER last_known_addr { host: "127.25.103.67" port: 34629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83547efebb5479b9f2be4d8056244ff" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efa6e64f5fd544668a00147f445753c5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260812 00:04:29.197597 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:29.195228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43886 (local address 127.25.103.67:34629)
0812 00:04:29.195294 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:29.195296 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:29.195304 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:04:29.195349 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:29.195349 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:29.195368 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:29.195451 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:04:29.195586 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.196069 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.196821 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:29.197027 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:29.197082 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:29.197236 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:04:29.197342 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:04:29.197446 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:29.197462 (+ 16us) server_negotiation.cc:299] Negotiation successful
0812 00:04:29.197484 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:04:29.199652 26200 raft_consensus.cc:1261] T 39fb6161808b400f9509f6147a8a8dbd P e83547efebb5479b9f2be4d8056244ff [term 1 FOLLOWER]: Refusing update from remote peer c45e6f4ae7b54e2e8ab94945ffdd0d73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:29.199652 26423 raft_consensus.cc:1261] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5 [term 1 FOLLOWER]: Refusing update from remote peer c45e6f4ae7b54e2e8ab94945ffdd0d73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:29.200038 26747 consensus_queue.cc:1035] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efa6e64f5fd544668a00147f445753c5" member_type: VOTER last_known_addr { host: "127.25.103.66" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:29.200199 26743 consensus_queue.cc:1035] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83547efebb5479b9f2be4d8056244ff" member_type: VOTER last_known_addr { host: "127.25.103.65" port: 46693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:29.202862 26751 mvcc.cc:205] Tried to move back new op lower bound from 7317475611438473216 to 7317475611307040768. Current Snapshot: MvccSnapshot[applied={T|T < 7317475611438473216}]
I20260812 00:04:29.203392 26752 mvcc.cc:205] Tried to move back new op lower bound from 7317475611438473216 to 7317475611307040768. Current Snapshot: MvccSnapshot[applied={T|T < 7317475611438473216}]
I20260812 00:04:29.204695 25979 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52668:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:29.204783 25979 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52668:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:29.205549 25979 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2f6bd437e7f4420f88a1fd0f4b800fd6: Sending DeleteTablet for 3 replicas of tablet 39fb6161808b400f9509f6147a8a8dbd
I20260812 00:04:29.205901 26599 tablet_service.cc:1514] Processing DeleteTablet for tablet 39fb6161808b400f9509f6147a8a8dbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:29 UTC) from {username='slave'} at 127.0.0.1:43880
I20260812 00:04:29.205981 26171 tablet_service.cc:1514] Processing DeleteTablet for tablet 39fb6161808b400f9509f6147a8a8dbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:29 UTC) from {username='slave'} at 127.0.0.1:53642
I20260812 00:04:29.206162 26387 tablet_service.cc:1514] Processing DeleteTablet for tablet 39fb6161808b400f9509f6147a8a8dbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:29 UTC) from {username='slave'} at 127.0.0.1:45066
I20260812 00:04:29.206414 26764 tablet_replica.cc:330] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5: stopping tablet replica
I20260812 00:04:29.206429 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 26078
I20260812 00:04:29.218598 26761 tablet_replica.cc:330] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73: stopping tablet replica
I20260812 00:04:29.218744 26761 raft_consensus.cc:2229] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:04:29.218843 26761 raft_consensus.cc:2258] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:29.225736 26761 ts_tablet_manager.cc:1905] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:04:29.227260 26761 ts_tablet_manager.cc:1918] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:29.227334 26761 log.cc:1196] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-2/wal/wals/39fb6161808b400f9509f6147a8a8dbd
I20260812 00:04:29.227543 26761 ts_tablet_manager.cc:1939] T 39fb6161808b400f9509f6147a8a8dbd P c45e6f4ae7b54e2e8ab94945ffdd0d73: Deleting consensus metadata
I20260812 00:04:29.230847 26764 raft_consensus.cc:2229] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:04:29.231015 26764 raft_consensus.cc:2258] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:29.231981 25955 catalog_manager.cc:4841] TS c45e6f4ae7b54e2e8ab94945ffdd0d73 (127.25.103.67:34629): tablet 39fb6161808b400f9509f6147a8a8dbd (table test-table [id=dcc717cf7b7f4a7381a0f73c8578ef72]) successfully deleted
I20260812 00:04:29.233383 26764 ts_tablet_manager.cc:1905] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:04:29.235212 26764 ts_tablet_manager.cc:1918] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:29.235302 26764 log.cc:1196] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5: Deleting WAL directory at /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492802321514-26013-0/minicluster-data/ts-1/wal/wals/39fb6161808b400f9509f6147a8a8dbd
I20260812 00:04:29.235566 26764 ts_tablet_manager.cc:1939] T 39fb6161808b400f9509f6147a8a8dbd P efa6e64f5fd544668a00147f445753c5: Deleting consensus metadata
I20260812 00:04:29.236178 25959 catalog_manager.cc:4841] TS efa6e64f5fd544668a00147f445753c5 (127.25.103.66:43007): tablet 39fb6161808b400f9509f6147a8a8dbd (table test-table [id=dcc717cf7b7f4a7381a0f73c8578ef72]) successfully deleted
W20260812 00:04:29.237993 25955 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.103.65:46693 (error 108)
I20260812 00:04:29.238227 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 26289
I20260812 00:04:29.240742 26719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:29.238361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.65:46693 (local address 127.0.0.1:53658)
0812 00:04:29.240613 (+ 2252us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:29.240695 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.65:46693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2217}
W20260812 00:04:29.245370 25955 catalog_manager.cc:4584] TS e83547efebb5479b9f2be4d8056244ff (127.25.103.65:46693): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 39fb6161808b400f9509f6147a8a8dbd: Network error: Client connection negotiation failed: client connection to 127.25.103.65:46693: connect: Connection refused (error 111)
I20260812 00:04:29.272490 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 26495
I20260812 00:04:29.286931 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 25930
2026-08-12T00:04:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (846 ms)
[----------] 6 tests from EncryptionPolicyTest (9179 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:29 dist-test-slave-vpvm krb5kdc[26775](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:29 dist-test-slave-vpvm krb5kdc[26775](info): set up 2 sockets
Aug 12 00:04:29 dist-test-slave-vpvm krb5kdc[26775](info): commencing operation
krb5kdc: starting...
W20260812 00:04:30.463012 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:30 dist-test-slave-vpvm krb5kdc[26775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:04:30.589008 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43685
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43685
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:30.672130 26792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:30.672408 26792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:30.672436 26792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:30.673596 26792 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:30.673641 26792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:30.673655 26792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:30.673666 26792 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:30.673677 26792 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:30.675271 26792 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43685
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:30.675630 26792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:30.675884 26792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:30.680815 26799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:30.680807 26798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:30.680811 26801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:30.681007 26792 server_base.cc:1034] running on GCE node
I20260812 00:04:30.681258 26792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:30.681558 26792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:30.682739 26792 hybrid_clock.cc:648] HybridClock initialized: now 1786493070682721 us; error 28 us; skew 500 ppm
Aug 12 00:04:30 dist-test-slave-vpvm krb5kdc[26775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493070, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:30.690240 26792 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:04:30.690734 26792 webserver.cc:460] Webserver started at http://127.0.0.1:37949/ using document root <none> and password file <none>
I20260812 00:04:30.690948 26792 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:30.690999 26792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:30.691126 26792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:30.692202 26792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "ee4493e3aacf493b984f393e2aaa80e4"
format_stamp: "Formatted at 2026-08-12 00:04:30 on dist-test-slave-vpvm"
server_key: "1915eb4ecec919474ac229b22a5d4ee4"
server_key_iv: "9ce9c688e4797790f91e65bf3b3d412b"
server_key_version: "encryptionkey@0"
I20260812 00:04:30.692535 26792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "ee4493e3aacf493b984f393e2aaa80e4"
format_stamp: "Formatted at 2026-08-12 00:04:30 on dist-test-slave-vpvm"
server_key: "1915eb4ecec919474ac229b22a5d4ee4"
server_key_iv: "9ce9c688e4797790f91e65bf3b3d412b"
server_key_version: "encryptionkey@0"
I20260812 00:04:30.693794 26792 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:04:30.694576 26809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:30.694725 26792 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:30.694813 26792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "ee4493e3aacf493b984f393e2aaa80e4"
format_stamp: "Formatted at 2026-08-12 00:04:30 on dist-test-slave-vpvm"
server_key: "1915eb4ecec919474ac229b22a5d4ee4"
server_key_iv: "9ce9c688e4797790f91e65bf3b3d412b"
server_key_version: "encryptionkey@0"
I20260812 00:04:30.694882 26792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:30.709476 26792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:30.711704 26792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:30.711856 26792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:30.716006 26792 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43685
I20260812 00:04:30.716059 26895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43685 every 8 connection(s)
I20260812 00:04:30.716395 26792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:30.717264 26897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:30.719661 26897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4: Bootstrap starting.
I20260812 00:04:30.720319 26897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:30.720611 26897 log.cc:824] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:30.721413 26897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4: No bootstrap required, opened a new log
I20260812 00:04:30.723132 26897 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee4493e3aacf493b984f393e2aaa80e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43685 } }
I20260812 00:04:30.723276 26897 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:30.723299 26897 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4493e3aacf493b984f393e2aaa80e4, State: Initialized, Role: FOLLOWER
I20260812 00:04:30.723459 26897 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee4493e3aacf493b984f393e2aaa80e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43685 } }
I20260812 00:04:30.723531 26897 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:30.723551 26897 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:30.723592 26897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:30.724141 26897 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee4493e3aacf493b984f393e2aaa80e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43685 } }
I20260812 00:04:30.724228 26897 leader_election.cc:302] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee4493e3aacf493b984f393e2aaa80e4; no voters:
I20260812 00:04:30.724402 26897 leader_election.cc:288] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:30.724459 26903 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:30.724629 26903 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4 [term 1 LEADER]: Becoming Leader. State: Replica: ee4493e3aacf493b984f393e2aaa80e4, State: Running, Role: LEADER
I20260812 00:04:30.724649 26897 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:30.724720 26903 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee4493e3aacf493b984f393e2aaa80e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43685 } }
I20260812 00:04:30.725072 26907 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee4493e3aacf493b984f393e2aaa80e4. Latest consensus state: current_term: 1 leader_uuid: "ee4493e3aacf493b984f393e2aaa80e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee4493e3aacf493b984f393e2aaa80e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43685 } } }
I20260812 00:04:30.725149 26907 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:30.725203 26905 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee4493e3aacf493b984f393e2aaa80e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee4493e3aacf493b984f393e2aaa80e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43685 } } }
I20260812 00:04:30.725281 26905 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:30.725375 26914 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:30.725519 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 26792
I20260812 00:04:30.725629 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:30.725818 26013 external_mini_cluster.cc:1428] Setting key 333fc164e4e3336d60e80398007764ce
I20260812 00:04:30.725863 26914 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:30.727484 26914 catalog_manager.cc:1347] Generated new cluster ID: c5f6023e7f354183b5b34620b57a4ff8
I20260812 00:04:30.727538 26914 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:04:30 dist-test-slave-vpvm krb5kdc[26775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:04:30.735467 26936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:30.726445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44003 (local address 127.0.0.1:43685)
0812 00:04:30.726814 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:30.726823 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:30.726855 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:04:30.726967 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:30.726974 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:30.727045 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:30.727190 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:30.727880 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:30.728791 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:30.729541 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:30.730036 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:30.730126 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:30.732340 (+ 2214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:30.732344 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:30.732344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:30.732356 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:30.733857 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:30.734246 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:30.734249 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:30.734249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:30.734348 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:30.734557 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:30.734558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:30.734559 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:30.734812 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:30.734964 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:30.735090 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 00:04:30.735283 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":75,"threads_started":1}
I20260812 00:04:30.736375 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:30.744736 26914 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:30.745486 26914 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:30.748018 26914 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee4493e3aacf493b984f393e2aaa80e4: Generated new TSK 0
I20260812 00:04:30.748201 26914 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:30.749790 26936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:30.737809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55033 (local address 127.0.0.1:43685)
0812 00:04:30.737846 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:30.737848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:30.742182 (+ 4334us) server_negotiation.cc:407] Connection header received
0812 00:04:30.742244 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:30.742245 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:30.742257 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:30.742300 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:30.742857 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:30.743515 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:30.744225 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:30.744589 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:30.744667 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:30.747249 (+ 2582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:30.747250 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:30.747251 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:30.747259 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:30.748692 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:30.749041 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:30.749043 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:30.749043 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:30.749107 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:30.749298 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:30.749298 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:30.749299 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:30.749409 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:30.749518 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:30.749641 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 00:04:30.749702 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":144,"server-negotiator.queue_time_us":18}
I20260812 00:04:30.751672 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 26792
W20260812 00:04:30.769035 26769 connection.cc:535] client connection to 127.0.0.1:43685 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43685): Connection reset by peer (error 104)
2026-08-12T00:04:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1472 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:30 dist-test-slave-vpvm krb5kdc[26948](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:30 dist-test-slave-vpvm krb5kdc[26948](info): set up 2 sockets
Aug 12 00:04:30 dist-test-slave-vpvm krb5kdc[26948](info): commencing operation
krb5kdc: starting...
W20260812 00:04:31.919740 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:32 dist-test-slave-vpvm krb5kdc[26948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:04:32.044858 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34063
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34063
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:32.127334 26973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:32.127550 26973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:32.127581 26973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:32.128715 26973 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:32.128759 26973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:32.128777 26973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:32.128794 26973 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:32.128810 26973 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:32.130306 26973 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34063
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:32.130539 26973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:32.130761 26973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:32.135507 26981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:32.135520 26984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:32.135520 26982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:32.135818 26973 server_base.cc:1034] running on GCE node
I20260812 00:04:32.136065 26973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:32.136348 26973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:32.137568 26973 hybrid_clock.cc:648] HybridClock initialized: now 1786493072137542 us; error 31 us; skew 500 ppm
Aug 12 00:04:32 dist-test-slave-vpvm krb5kdc[26948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493072, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:32.140141 26973 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:04:32.140604 26973 webserver.cc:460] Webserver started at http://127.0.0.1:44383/ using document root <none> and password file <none>
I20260812 00:04:32.140825 26973 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:32.140875 26973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:32.141000 26973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:32.142149 26973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "a91887d639df496d9d653833718641b1"
format_stamp: "Formatted at 2026-08-12 00:04:32 on dist-test-slave-vpvm"
server_key: "f7450b4d0be4477516766d3a60b66fb8"
server_key_iv: "ea881967b7d8b226436970150f3fef7a"
server_key_version: "encryptionkey@0"
I20260812 00:04:32.142494 26973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "a91887d639df496d9d653833718641b1"
format_stamp: "Formatted at 2026-08-12 00:04:32 on dist-test-slave-vpvm"
server_key: "f7450b4d0be4477516766d3a60b66fb8"
server_key_iv: "ea881967b7d8b226436970150f3fef7a"
server_key_version: "encryptionkey@0"
I20260812 00:04:32.143854 26973 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:04:32.144591 26992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:32.144783 26973 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:04:32.144882 26973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "a91887d639df496d9d653833718641b1"
format_stamp: "Formatted at 2026-08-12 00:04:32 on dist-test-slave-vpvm"
server_key: "f7450b4d0be4477516766d3a60b66fb8"
server_key_iv: "ea881967b7d8b226436970150f3fef7a"
server_key_version: "encryptionkey@0"
I20260812 00:04:32.144946 26973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:32.158185 26973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:32.160352 26973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:32.160517 26973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:32.164608 26973 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34063
I20260812 00:04:32.164647 27082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34063 every 8 connection(s)
I20260812 00:04:32.164999 26973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:32.165880 27085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:32.168284 27085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1: Bootstrap starting.
I20260812 00:04:32.168902 27085 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:32.169185 27085 log.cc:824] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:32.169907 27085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1: No bootstrap required, opened a new log
I20260812 00:04:32.170488 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 26973
I20260812 00:04:32.170601 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:32.170791 26013 external_mini_cluster.cc:1428] Setting key dd6f216721ce6d5f3c5c47104a9c4592
I20260812 00:04:32.171996 27085 raft_consensus.cc:348] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a91887d639df496d9d653833718641b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34063 } }
I20260812 00:04:32.172166 27085 raft_consensus.cc:374] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:32.172205 27085 raft_consensus.cc:729] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91887d639df496d9d653833718641b1, State: Initialized, Role: FOLLOWER
I20260812 00:04:32.172339 27085 consensus_queue.cc:260] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a91887d639df496d9d653833718641b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34063 } }
I20260812 00:04:32.172418 27085 raft_consensus.cc:388] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:32.172441 27085 raft_consensus.cc:482] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:32.172487 27085 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:32.173089 27085 raft_consensus.cc:504] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a91887d639df496d9d653833718641b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34063 } }
I20260812 00:04:32.173182 27085 leader_election.cc:302] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a91887d639df496d9d653833718641b1; no voters:
I20260812 00:04:32.173355 27085 leader_election.cc:288] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:32.173388 27095 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:32.173545 27095 raft_consensus.cc:686] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1 [term 1 LEADER]: Becoming Leader. State: Replica: a91887d639df496d9d653833718641b1, State: Running, Role: LEADER
I20260812 00:04:32.173653 27085 sys_catalog.cc:564] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:32.173719 27095 consensus_queue.cc:237] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a91887d639df496d9d653833718641b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34063 } }
I20260812 00:04:32.174233 27098 sys_catalog.cc:455] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a91887d639df496d9d653833718641b1. Latest consensus state: current_term: 1 leader_uuid: "a91887d639df496d9d653833718641b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a91887d639df496d9d653833718641b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34063 } } }
I20260812 00:04:32.174324 27098 sys_catalog.cc:458] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:32.174520 27101 sys_catalog.cc:455] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a91887d639df496d9d653833718641b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a91887d639df496d9d653833718641b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34063 } } }
I20260812 00:04:32.174626 27101 sys_catalog.cc:458] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:32.174851 27115 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:32.175500 27115 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:32.177181 27115 catalog_manager.cc:1347] Generated new cluster ID: fc05670419cd459d9ae19458c61c418a
I20260812 00:04:32.177217 27093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:32.171448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60251 (local address 127.0.0.1:34063)
0812 00:04:32.171710 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:32.171719 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:32.171749 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:04:32.171949 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:32.171954 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:32.171999 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:32.172120 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:32.172383 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:32.173813 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:32.174950 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:32.175580 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:32.175692 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:32.176463 (+ 771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:32.176467 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:32.176468 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:32.176679 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:32.176718 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:32.176730 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:32.176802 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:32.176954 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 00:04:32.176987 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":162,"threads_started":1}
I20260812 00:04:32.177235 27115 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:32.178259 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:32.183298 27093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:32.179817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46383 (local address 127.0.0.1:34063)
0812 00:04:32.179854 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:32.179856 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:32.179913 (+ 57us) server_negotiation.cc:407] Connection header received
0812 00:04:32.179968 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:32.179968 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:32.179978 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:32.180051 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:32.180161 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:32.180893 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:32.181876 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:32.182239 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:32.182316 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:32.183030 (+ 714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:32.183032 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:32.183032 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:32.183037 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:32.183063 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:32.183068 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:32.183143 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:32.183199 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 00:04:32.183214 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:04:32.191473 27115 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:32.192250 27115 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:32.200407 27115 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a91887d639df496d9d653833718641b1: Generated new TSK 0
I20260812 00:04:32.200629 27115 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:32.210306 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 26973
W20260812 00:04:32.234076 26946 connection.cc:535] client connection to 127.0.0.1:34063 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34063): Connection reset by peer (error 104)
2026-08-12T00:04:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1464 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:32 dist-test-slave-vpvm krb5kdc[27141](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:32 dist-test-slave-vpvm krb5kdc[27141](info): set up 2 sockets
Aug 12 00:04:32 dist-test-slave-vpvm krb5kdc[27141](info): commencing operation
krb5kdc: starting...
W20260812 00:04:33.404801 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:33 dist-test-slave-vpvm krb5kdc[27141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:04:33.529431 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36965
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36965
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:33.613684 27158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:33.613920 27158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:33.613986 27158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:33.615213 27158 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:33.615262 27158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:33.615281 27158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:33.615298 27158 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:33.615312 27158 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:33.616807 27158 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36965
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27158
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:33.617063 27158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:33.617283 27158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:33.622129 27165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:33.622187 27158 server_base.cc:1034] running on GCE node
W20260812 00:04:33.622129 27168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:33.622195 27163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:33.622715 27158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:33.623003 27158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:33.624166 27158 hybrid_clock.cc:648] HybridClock initialized: now 1786493073624148 us; error 32 us; skew 500 ppm
Aug 12 00:04:33 dist-test-slave-vpvm krb5kdc[27141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493073, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:33.626668 27158 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:04:33.627100 27158 webserver.cc:460] Webserver started at http://127.0.0.1:43323/ using document root <none> and password file <none>
I20260812 00:04:33.627295 27158 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:33.627337 27158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:33.627452 27158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:33.628553 27158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "58e90f36e7f34df0a328ed04613b602c"
format_stamp: "Formatted at 2026-08-12 00:04:33 on dist-test-slave-vpvm"
server_key: "96751cd78a5e005a4107f7c9ad67253a"
server_key_iv: "4806e23551dc11e9ad2447cb540a5c8b"
server_key_version: "encryptionkey@0"
I20260812 00:04:33.628912 27158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "58e90f36e7f34df0a328ed04613b602c"
format_stamp: "Formatted at 2026-08-12 00:04:33 on dist-test-slave-vpvm"
server_key: "96751cd78a5e005a4107f7c9ad67253a"
server_key_iv: "4806e23551dc11e9ad2447cb540a5c8b"
server_key_version: "encryptionkey@0"
I20260812 00:04:33.630329 27158 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:04:33.631080 27180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:33.631289 27158 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:04:33.631392 27158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "58e90f36e7f34df0a328ed04613b602c"
format_stamp: "Formatted at 2026-08-12 00:04:33 on dist-test-slave-vpvm"
server_key: "96751cd78a5e005a4107f7c9ad67253a"
server_key_iv: "4806e23551dc11e9ad2447cb540a5c8b"
server_key_version: "encryptionkey@0"
I20260812 00:04:33.631453 27158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:33.634837 27158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:33.636826 27158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:33.636934 27158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:33.640779 27158 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36965
I20260812 00:04:33.640821 27274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36965 every 8 connection(s)
I20260812 00:04:33.641132 27158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:33.642213 27275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:33.644642 27275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c: Bootstrap starting.
I20260812 00:04:33.645262 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 27158
I20260812 00:04:33.645294 27275 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:33.645393 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:33.645610 26013 external_mini_cluster.cc:1428] Setting key bc5f36fda0742a706b2ddde3874d0f10
I20260812 00:04:33.645643 27275 log.cc:824] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:33.646651 27275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c: No bootstrap required, opened a new log
I20260812 00:04:33.648218 27283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:33.646186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60261 (local address 127.0.0.1:36965)
0812 00:04:33.646350 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:33.646359 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:33.646394 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:04:33.646990 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:33.646999 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:33.647032 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:33.647190 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:33.647788 (+ 598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:33.647791 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:33.647792 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:33.647796 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:33.647841 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:33.647855 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:33.647956 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:33.647986 (+ 30us) server_negotiation.cc:299] Negotiation successful
0812 00:04:33.648027 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":65,"threads_started":1}
I20260812 00:04:33.649139 27275 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e90f36e7f34df0a328ed04613b602c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36965 } }
I20260812 00:04:33.649284 27275 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:33.649293 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:33.649325 27275 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58e90f36e7f34df0a328ed04613b602c, State: Initialized, Role: FOLLOWER
I20260812 00:04:33.649443 27275 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e90f36e7f34df0a328ed04613b602c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36965 } }
I20260812 00:04:33.649528 27275 raft_consensus.cc:388] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:33.649559 27275 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:33.649597 27275 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:33.650344 27275 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e90f36e7f34df0a328ed04613b602c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36965 } }
I20260812 00:04:33.650473 27275 leader_election.cc:302] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58e90f36e7f34df0a328ed04613b602c; no voters:
I20260812 00:04:33.650635 27275 leader_election.cc:288] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:33.650677 27292 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:33.650870 27275 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:33.651147 27292 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c [term 1 LEADER]: Becoming Leader. State: Replica: 58e90f36e7f34df0a328ed04613b602c, State: Running, Role: LEADER
I20260812 00:04:33.651257 27292 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e90f36e7f34df0a328ed04613b602c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36965 } }
I20260812 00:04:33.651600 27293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58e90f36e7f34df0a328ed04613b602c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e90f36e7f34df0a328ed04613b602c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36965 } } }
I20260812 00:04:33.651686 27293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:33.651616 27295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58e90f36e7f34df0a328ed04613b602c. Latest consensus state: current_term: 1 leader_uuid: "58e90f36e7f34df0a328ed04613b602c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e90f36e7f34df0a328ed04613b602c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36965 } } }
I20260812 00:04:33.651889 27302 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:33.651903 27295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:33.652128 27283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:33.650890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35705 (local address 127.0.0.1:36965)
0812 00:04:33.650932 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:33.650933 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:33.651137 (+ 204us) server_negotiation.cc:407] Connection header received
0812 00:04:33.651201 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:33.651201 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:33.651206 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:33.651271 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:33.651852 (+ 581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:33.651853 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:33.651853 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:33.651857 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:33.651871 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:33.651875 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:33.651926 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:33.652056 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 00:04:33.652068 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:04:33.652495 27302 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:33.653996 27302 catalog_manager.cc:1347] Generated new cluster ID: 640b411992964015ba4f0c1090d5538e
I20260812 00:04:33.654043 27302 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:33.662904 27302 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:33.663062 27302 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:33.672863 27302 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58e90f36e7f34df0a328ed04613b602c: Generated new TSK 0
I20260812 00:04:33.673055 27302 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:33.677350 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 27158
2026-08-12T00:04:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1453 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:33 dist-test-slave-vpvm krb5kdc[27321](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:33 dist-test-slave-vpvm krb5kdc[27321](info): set up 2 sockets
Aug 12 00:04:33 dist-test-slave-vpvm krb5kdc[27321](info): commencing operation
krb5kdc: starting...
W20260812 00:04:34.844108 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:34 dist-test-slave-vpvm krb5kdc[27321](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493074, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:04:34.968822 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33011
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:35.052215 27345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:35.052443 27345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:35.052466 27345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:35.053591 27345 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:35.053637 27345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:35.053650 27345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:35.053661 27345 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:35.053673 27345 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:35.055203 27345 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:35.055445 27345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:35.055678 27345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:35.060541 27352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:35.060562 27351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:35.060555 27354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:35.060766 27345 server_base.cc:1034] running on GCE node
I20260812 00:04:35.060978 27345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:35.061255 27345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:35.062402 27345 hybrid_clock.cc:648] HybridClock initialized: now 1786493075062384 us; error 36 us; skew 500 ppm
Aug 12 00:04:35 dist-test-slave-vpvm krb5kdc[27321](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493075, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:35.064904 27345 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:04:35.065353 27345 webserver.cc:460] Webserver started at http://127.0.0.1:39157/ using document root <none> and password file <none>
I20260812 00:04:35.065577 27345 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:35.065626 27345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:35.065752 27345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:35.066869 27345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "75ed35340d06421c9779f2cff291f1f3"
format_stamp: "Formatted at 2026-08-12 00:04:35 on dist-test-slave-vpvm"
server_key: "ddada33d59270f06c9e2f11842ca058d"
server_key_iv: "e2a49f8a08504343fd84de5d80025e9f"
server_key_version: "encryptionkey@0"
I20260812 00:04:35.067214 27345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "75ed35340d06421c9779f2cff291f1f3"
format_stamp: "Formatted at 2026-08-12 00:04:35 on dist-test-slave-vpvm"
server_key: "ddada33d59270f06c9e2f11842ca058d"
server_key_iv: "e2a49f8a08504343fd84de5d80025e9f"
server_key_version: "encryptionkey@0"
I20260812 00:04:35.068519 27345 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:04:35.069317 27365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:35.069478 27345 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:35.069558 27345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "75ed35340d06421c9779f2cff291f1f3"
format_stamp: "Formatted at 2026-08-12 00:04:35 on dist-test-slave-vpvm"
server_key: "ddada33d59270f06c9e2f11842ca058d"
server_key_iv: "e2a49f8a08504343fd84de5d80025e9f"
server_key_version: "encryptionkey@0"
I20260812 00:04:35.069630 27345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:35.096946 27345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:35.099030 27345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:35.099172 27345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:35.103194 27345 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33011
I20260812 00:04:35.103240 27449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33011 every 8 connection(s)
I20260812 00:04:35.103571 27345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:35.104489 27450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:35.104682 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 27345
I20260812 00:04:35.104791 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:35.104960 26013 external_mini_cluster.cc:1428] Setting key f7878917730d252ce3c8db3268e02fa7
I20260812 00:04:35.107815 27450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3: Bootstrap starting.
I20260812 00:04:35.108529 27450 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:35.108846 27450 log.cc:824] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:35.109611 27450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3: No bootstrap required, opened a new log
Aug 12 00:04:35 dist-test-slave-vpvm krb5kdc[27321](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493074, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:04:35.112092 27450 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75ed35340d06421c9779f2cff291f1f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33011 } }
I20260812 00:04:35.112286 27450 raft_consensus.cc:374] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:35.112339 27450 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ed35340d06421c9779f2cff291f1f3, State: Initialized, Role: FOLLOWER
I20260812 00:04:35.112465 27450 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75ed35340d06421c9779f2cff291f1f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33011 } }
I20260812 00:04:35.112541 27450 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:35.112573 27450 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:35.112620 27450 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:35.113196 27450 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75ed35340d06421c9779f2cff291f1f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33011 } }
I20260812 00:04:35.113299 27450 leader_election.cc:302] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75ed35340d06421c9779f2cff291f1f3; no voters:
I20260812 00:04:35.113484 27450 leader_election.cc:288] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:35.113523 27460 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:35.113698 27460 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3 [term 1 LEADER]: Becoming Leader. State: Replica: 75ed35340d06421c9779f2cff291f1f3, State: Running, Role: LEADER
I20260812 00:04:35.113775 27450 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:35.113857 27460 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75ed35340d06421c9779f2cff291f1f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33011 } }
I20260812 00:04:35.114313 27463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75ed35340d06421c9779f2cff291f1f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75ed35340d06421c9779f2cff291f1f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33011 } } }
I20260812 00:04:35.114311 27460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75ed35340d06421c9779f2cff291f1f3. Latest consensus state: current_term: 1 leader_uuid: "75ed35340d06421c9779f2cff291f1f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75ed35340d06421c9779f2cff291f1f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33011 } } }
I20260812 00:04:35.114445 27463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:35.114465 27460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:35.115201 27474 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:35.115921 27474 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:35.116331 27455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:35.105433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41311 (local address 127.0.0.1:33011)
0812 00:04:35.105589 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:35.105597 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:35.105621 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:04:35.106115 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:35.106122 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:35.106168 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:35.106290 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:35.107100 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:35.108060 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:35.109048 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:35.109562 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:35.109671 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:35.112377 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:35.112383 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:35.112383 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:35.112396 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:35.114455 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:35.114879 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:35.114883 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:35.114884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:35.115018 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:35.115230 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:35.115231 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:35.115231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:35.115536 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:35.115693 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:35.115972 (+ 279us) server_negotiation.cc:299] Negotiation successful
0812 00:04:35.116128 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":66,"threads_started":1}
I20260812 00:04:35.117321 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:35.117532 27474 catalog_manager.cc:1347] Generated new cluster ID: 3fa9239420694386a8f564051ebc060c
I20260812 00:04:35.117571 27474 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:35.125877 27455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:35.118858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49663 (local address 127.0.0.1:33011)
0812 00:04:35.118910 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:35.118912 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:35.119035 (+ 123us) server_negotiation.cc:407] Connection header received
0812 00:04:35.119068 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:35.119068 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:35.119079 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:35.119146 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:35.119749 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:35.120509 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:35.121462 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:35.121801 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:35.121875 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:35.123233 (+ 1358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:35.123235 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:35.123235 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:35.123243 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:35.124785 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:35.125141 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:35.125142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:35.125142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:35.125208 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:35.125368 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:35.125369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:35.125369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:35.125502 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:35.125595 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:35.125691 (+ 96us) server_negotiation.cc:299] Negotiation successful
0812 00:04:35.125775 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:04:35.127400 27474 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:35.127888 27474 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:35.132427 27474 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75ed35340d06421c9779f2cff291f1f3: Generated new TSK 0
I20260812 00:04:35.132649 27474 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:35.135588 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 27345
2026-08-12T00:04:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1465 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:35 dist-test-slave-vpvm krb5kdc[27496](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:35 dist-test-slave-vpvm krb5kdc[27496](info): set up 2 sockets
Aug 12 00:04:35 dist-test-slave-vpvm krb5kdc[27496](info): commencing operation
krb5kdc: starting...
W20260812 00:04:36.320598 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:36 dist-test-slave-vpvm krb5kdc[27496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:04:36.446591 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42881
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42881
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:36.531117 27516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:36.531349 27516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:36.531384 27516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:36.532562 27516 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:36.532609 27516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:36.532627 27516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:36.532644 27516 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:36.532660 27516 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:36.534202 27516 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42881
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:36.534461 27516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:36.534677 27516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:36.539594 27525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:36.539630 27529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:36.539690 27526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:36.539639 27516 server_base.cc:1034] running on GCE node
I20260812 00:04:36.539964 27516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:36.540256 27516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:36.541411 27516 hybrid_clock.cc:648] HybridClock initialized: now 1786493076541396 us; error 30 us; skew 500 ppm
Aug 12 00:04:36 dist-test-slave-vpvm krb5kdc[27496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493076, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:36.547277 27516 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:04:36.547734 27516 webserver.cc:460] Webserver started at http://127.0.0.1:38959/ using document root <none> and password file <none>
I20260812 00:04:36.547942 27516 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:36.548005 27516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:36.548136 27516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:36.549217 27516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "a48328e799fc456a8958071519643e50"
format_stamp: "Formatted at 2026-08-12 00:04:36 on dist-test-slave-vpvm"
server_key: "47b5486f262e5e954787db9b19504553"
server_key_iv: "94f684c7049296884aa075b894ebc440"
server_key_version: "encryptionkey@0"
I20260812 00:04:36.549571 27516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "a48328e799fc456a8958071519643e50"
format_stamp: "Formatted at 2026-08-12 00:04:36 on dist-test-slave-vpvm"
server_key: "47b5486f262e5e954787db9b19504553"
server_key_iv: "94f684c7049296884aa075b894ebc440"
server_key_version: "encryptionkey@0"
I20260812 00:04:36.551091 27516 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:04:36.551923 27540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:36.552102 27516 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:36.552192 27516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "a48328e799fc456a8958071519643e50"
format_stamp: "Formatted at 2026-08-12 00:04:36 on dist-test-slave-vpvm"
server_key: "47b5486f262e5e954787db9b19504553"
server_key_iv: "94f684c7049296884aa075b894ebc440"
server_key_version: "encryptionkey@0"
I20260812 00:04:36.552258 27516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:36.564427 27516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:36.566740 27516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:36.566900 27516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:36.571070 27516 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42881
I20260812 00:04:36.571113 27625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42881 every 8 connection(s)
I20260812 00:04:36.571457 27516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:36.572394 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 27516
I20260812 00:04:36.572501 27626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:36.572539 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:36.572721 26013 external_mini_cluster.cc:1428] Setting key 6d9f62450c0474bf6dadf1b1337a6f79
I20260812 00:04:36.576038 27626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50: Bootstrap starting.
I20260812 00:04:36.576691 27626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:36.577001 27626 log.cc:824] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:36.577790 27626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50: No bootstrap required, opened a new log
I20260812 00:04:36.578929 27631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:36.573321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39085 (local address 127.0.0.1:42881)
0812 00:04:36.573521 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:36.573531 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:36.573567 (+ 36us) server_negotiation.cc:407] Connection header received
0812 00:04:36.574105 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:36.574114 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:36.574181 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:36.574330 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:36.574568 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:36.575932 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:36.576759 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:36.577360 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:36.577442 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:36.578248 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:36.578253 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:36.578253 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:36.578457 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:36.578502 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:36.578517 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:36.578593 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:36.578632 (+ 39us) server_negotiation.cc:299] Negotiation successful
0812 00:04:36.578704 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":87,"threads_started":1}
I20260812 00:04:36.579779 27626 raft_consensus.cc:348] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a48328e799fc456a8958071519643e50" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42881 } }
I20260812 00:04:36.579957 27626 raft_consensus.cc:374] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:36.580018 27626 raft_consensus.cc:729] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a48328e799fc456a8958071519643e50, State: Initialized, Role: FOLLOWER
I20260812 00:04:36.580145 27626 consensus_queue.cc:260] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a48328e799fc456a8958071519643e50" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42881 } }
I20260812 00:04:36.580231 27626 raft_consensus.cc:388] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:36.580273 27626 raft_consensus.cc:482] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:36.580327 27626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:36.580322 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:36.580933 27626 raft_consensus.cc:504] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a48328e799fc456a8958071519643e50" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42881 } }
I20260812 00:04:36.581029 27626 leader_election.cc:302] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a48328e799fc456a8958071519643e50; no voters:
I20260812 00:04:36.581202 27626 leader_election.cc:288] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:36.581251 27635 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:36.581406 27635 raft_consensus.cc:686] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50 [term 1 LEADER]: Becoming Leader. State: Replica: a48328e799fc456a8958071519643e50, State: Running, Role: LEADER
I20260812 00:04:36.581521 27626 sys_catalog.cc:564] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:36.581550 27635 consensus_queue.cc:237] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a48328e799fc456a8958071519643e50" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42881 } }
I20260812 00:04:36.582082 27635 sys_catalog.cc:455] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a48328e799fc456a8958071519643e50. Latest consensus state: current_term: 1 leader_uuid: "a48328e799fc456a8958071519643e50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a48328e799fc456a8958071519643e50" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42881 } } }
I20260812 00:04:36.582253 27635 sys_catalog.cc:458] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:36.582094 27642 sys_catalog.cc:455] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a48328e799fc456a8958071519643e50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a48328e799fc456a8958071519643e50" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42881 } } }
I20260812 00:04:36.582463 27642 sys_catalog.cc:458] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:36.582460 27658 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:36.583083 27658 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:36.584817 27658 catalog_manager.cc:1347] Generated new cluster ID: 06590e33e80e498aa25722251f95aba9
I20260812 00:04:36.584872 27658 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:36.585213 27631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:36.581706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41693 (local address 127.0.0.1:42881)
0812 00:04:36.581745 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:36.581747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:36.581844 (+ 97us) server_negotiation.cc:407] Connection header received
0812 00:04:36.581897 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:36.581899 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:36.581909 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:36.581982 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:36.582140 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:36.582824 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:36.583821 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:36.584098 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:36.584181 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:36.584853 (+ 672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:36.584855 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:36.584855 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:36.584860 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:36.584876 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:36.584880 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:36.584932 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:36.585117 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 00:04:36.585142 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:04:36.589493 27658 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:36.590174 27658 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:36.592356 27658 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a48328e799fc456a8958071519643e50: Generated new TSK 0
I20260812 00:04:36.592525 27658 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:36.597702 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 27516
2026-08-12T00:04:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1461 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:36 dist-test-slave-vpvm krb5kdc[27678](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:36 dist-test-slave-vpvm krb5kdc[27678](info): set up 2 sockets
Aug 12 00:04:36 dist-test-slave-vpvm krb5kdc[27678](info): commencing operation
krb5kdc: starting...
W20260812 00:04:37.780489 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:37 dist-test-slave-vpvm krb5kdc[27678](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493077, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:04:37.909721 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33843
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33843
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:37.994768 27699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:37.995036 27699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:37.995072 27699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:37.996367 27699 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:37.996419 27699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:37.996438 27699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:37.996454 27699 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:37.996469 27699 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:37.998131 27699 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33843
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:37.998405 27699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:37.998636 27699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:38.003521 27704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:38.003566 27706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:38.003551 27708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:38.003877 27699 server_base.cc:1034] running on GCE node
I20260812 00:04:38.004112 27699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:38.004397 27699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:38.005556 27699 hybrid_clock.cc:648] HybridClock initialized: now 1786493078005537 us; error 29 us; skew 500 ppm
Aug 12 00:04:38 dist-test-slave-vpvm krb5kdc[27678](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493078, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:38.008023 27699 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:04:38.008488 27699 webserver.cc:460] Webserver started at http://127.0.0.1:40419/ using document root <none> and password file <none>
I20260812 00:04:38.008693 27699 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:38.008742 27699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:38.008870 27699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:38.009999 27699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "b0112dbd4e694ed5b4ad9dacd78a301c"
format_stamp: "Formatted at 2026-08-12 00:04:38 on dist-test-slave-vpvm"
server_key: "9b57293d0eafdd843f9068d67b8cfa76"
server_key_iv: "3e6054a7c959a116db9ead2ac5ed0739"
server_key_version: "encryptionkey@0"
I20260812 00:04:38.010367 27699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "b0112dbd4e694ed5b4ad9dacd78a301c"
format_stamp: "Formatted at 2026-08-12 00:04:38 on dist-test-slave-vpvm"
server_key: "9b57293d0eafdd843f9068d67b8cfa76"
server_key_iv: "3e6054a7c959a116db9ead2ac5ed0739"
server_key_version: "encryptionkey@0"
I20260812 00:04:38.011675 27699 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:38.012382 27718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:38.012522 27699 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:38.012609 27699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "b0112dbd4e694ed5b4ad9dacd78a301c"
format_stamp: "Formatted at 2026-08-12 00:04:38 on dist-test-slave-vpvm"
server_key: "9b57293d0eafdd843f9068d67b8cfa76"
server_key_iv: "3e6054a7c959a116db9ead2ac5ed0739"
server_key_version: "encryptionkey@0"
I20260812 00:04:38.012677 27699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:38.016147 27699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:38.018414 27699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:38.018544 27699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:38.022572 27699 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33843
I20260812 00:04:38.022662 27811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33843 every 8 connection(s)
I20260812 00:04:38.022938 27699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:38.023962 27812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:38.025651 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 27699
I20260812 00:04:38.025767 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:38.025998 26013 external_mini_cluster.cc:1428] Setting key b17d03172485f7ae15ba42fc51a6d05c
I20260812 00:04:38.026660 27812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c: Bootstrap starting.
I20260812 00:04:38.027405 27812 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:38.027760 27812 log.cc:824] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:38.028581 27812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c: No bootstrap required, opened a new log
I20260812 00:04:38.028769 27816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:38.026557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47359 (local address 127.0.0.1:33843)
0812 00:04:38.026751 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:38.026760 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:38.026799 (+ 39us) server_negotiation.cc:407] Connection header received
0812 00:04:38.027401 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:38.027410 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:38.027448 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:38.027631 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:38.028223 (+ 592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:38.028227 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:38.028228 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:38.028232 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:38.028281 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:38.028294 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:38.028424 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:38.028474 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 00:04:38.028520 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":87,"threads_started":1}
I20260812 00:04:38.029748 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:38.031204 27812 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0112dbd4e694ed5b4ad9dacd78a301c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33843 } }
I20260812 00:04:38.031386 27812 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:38.031424 27812 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0112dbd4e694ed5b4ad9dacd78a301c, State: Initialized, Role: FOLLOWER
I20260812 00:04:38.031599 27812 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0112dbd4e694ed5b4ad9dacd78a301c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33843 } }
I20260812 00:04:38.031714 27812 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:38.031749 27812 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:38.031801 27812 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:38.032462 27816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:38.031455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50901 (local address 127.0.0.1:33843)
0812 00:04:38.031539 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:38.031541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:38.031596 (+ 55us) server_negotiation.cc:407] Connection header received
0812 00:04:38.031666 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:38.031667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:38.031671 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:38.031716 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:38.032224 (+ 508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:38.032225 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:38.032226 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:38.032229 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:38.032243 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:38.032247 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:38.032289 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:38.032378 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 00:04:38.032396 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 00:04:38.032580 27812 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0112dbd4e694ed5b4ad9dacd78a301c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33843 } }
I20260812 00:04:38.032694 27812 leader_election.cc:302] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0112dbd4e694ed5b4ad9dacd78a301c; no voters:
I20260812 00:04:38.032832 27812 leader_election.cc:288] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:38.032883 27825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:38.033037 27825 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c [term 1 LEADER]: Becoming Leader. State: Replica: b0112dbd4e694ed5b4ad9dacd78a301c, State: Running, Role: LEADER
I20260812 00:04:38.033156 27812 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:38.033156 27825 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0112dbd4e694ed5b4ad9dacd78a301c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33843 } }
I20260812 00:04:38.033670 27826 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0112dbd4e694ed5b4ad9dacd78a301c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0112dbd4e694ed5b4ad9dacd78a301c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33843 } } }
I20260812 00:04:38.033704 27828 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0112dbd4e694ed5b4ad9dacd78a301c. Latest consensus state: current_term: 1 leader_uuid: "b0112dbd4e694ed5b4ad9dacd78a301c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0112dbd4e694ed5b4ad9dacd78a301c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33843 } } }
I20260812 00:04:38.033778 27826 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:38.033788 27828 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:38.034247 27842 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:38.034790 27842 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:38.036336 27842 catalog_manager.cc:1347] Generated new cluster ID: 02772f4dbc2643eeaf414a01f6dd11a1
I20260812 00:04:38.036381 27842 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:38.060367 27842 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:38.060575 27842 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:38.076988 27842 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0112dbd4e694ed5b4ad9dacd78a301c: Generated new TSK 0
I20260812 00:04:38.077251 27842 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:38.079584 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 27699
2026-08-12T00:04:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1478 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:38 dist-test-slave-vpvm krb5kdc[27861](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:38 dist-test-slave-vpvm krb5kdc[27861](info): set up 2 sockets
Aug 12 00:04:38 dist-test-slave-vpvm krb5kdc[27861](info): commencing operation
krb5kdc: starting...
W20260812 00:04:39.266688 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:39 dist-test-slave-vpvm krb5kdc[27861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:04:39.390434 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33017
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33017
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:39.479709 27887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:39.479940 27887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:39.479966 27887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:39.481139 27887 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:39.481192 27887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:39.481206 27887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:39.481218 27887 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:39.481228 27887 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:39.482831 27887 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33017
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:39.483078 27887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:39.483300 27887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:39.488663 27895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:39.488672 27899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:39.488663 27894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:39.489092 27887 server_base.cc:1034] running on GCE node
I20260812 00:04:39.489661 27887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:39.490056 27887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:39.491245 27887 hybrid_clock.cc:648] HybridClock initialized: now 1786493079491230 us; error 34 us; skew 500 ppm
Aug 12 00:04:39 dist-test-slave-vpvm krb5kdc[27861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493079, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:39.494608 27887 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:04:39.495330 27887 webserver.cc:460] Webserver started at http://127.0.0.1:40381/ using document root <none> and password file <none>
I20260812 00:04:39.495695 27887 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:39.495775 27887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:39.495929 27887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:39.497105 27887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "d7954070493c4a5798a1f359afdaa6fa"
format_stamp: "Formatted at 2026-08-12 00:04:39 on dist-test-slave-vpvm"
server_key: "24702756753615e621353a7ce08e15fd"
server_key_iv: "125301496e68b4f8a4469f77990dbee5"
server_key_version: "encryptionkey@0"
I20260812 00:04:39.497617 27887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "d7954070493c4a5798a1f359afdaa6fa"
format_stamp: "Formatted at 2026-08-12 00:04:39 on dist-test-slave-vpvm"
server_key: "24702756753615e621353a7ce08e15fd"
server_key_iv: "125301496e68b4f8a4469f77990dbee5"
server_key_version: "encryptionkey@0"
I20260812 00:04:39.499267 27887 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260812 00:04:39.500229 27911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:39.500515 27887 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:04:39.500685 27887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "d7954070493c4a5798a1f359afdaa6fa"
format_stamp: "Formatted at 2026-08-12 00:04:39 on dist-test-slave-vpvm"
server_key: "24702756753615e621353a7ce08e15fd"
server_key_iv: "125301496e68b4f8a4469f77990dbee5"
server_key_version: "encryptionkey@0"
I20260812 00:04:39.500885 27887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:39.514097 27887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:39.516930 27887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:39.517095 27887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:39.521540 27887 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33017
I20260812 00:04:39.521606 28002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33017 every 8 connection(s)
I20260812 00:04:39.521984 27887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:39.523085 28003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:39.526103 28003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa: Bootstrap starting.
I20260812 00:04:39.526526 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 27887
I20260812 00:04:39.526638 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:39.526793 28003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:39.526818 26013 external_mini_cluster.cc:1428] Setting key 0e5a0d7c5f1c3fcc0b1f1056caa43fd7
I20260812 00:04:39.527141 28003 log.cc:824] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:39.527951 28003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa: No bootstrap required, opened a new log
I20260812 00:04:39.531498 28003 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7954070493c4a5798a1f359afdaa6fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33017 } }
I20260812 00:04:39.531756 28003 raft_consensus.cc:374] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:39.531795 28003 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7954070493c4a5798a1f359afdaa6fa, State: Initialized, Role: FOLLOWER
I20260812 00:04:39.531936 28003 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7954070493c4a5798a1f359afdaa6fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33017 } }
I20260812 00:04:39.532028 28003 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:39.532066 28003 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:39.532111 28003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:39.533071 28003 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7954070493c4a5798a1f359afdaa6fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33017 } }
I20260812 00:04:39.533196 28003 leader_election.cc:302] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7954070493c4a5798a1f359afdaa6fa; no voters:
I20260812 00:04:39.533414 28003 leader_election.cc:288] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:39.533483 28010 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:39.533725 28010 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa [term 1 LEADER]: Becoming Leader. State: Replica: d7954070493c4a5798a1f359afdaa6fa, State: Running, Role: LEADER
I20260812 00:04:39.533705 28003 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:39.533881 28010 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7954070493c4a5798a1f359afdaa6fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33017 } }
I20260812 00:04:39.534381 28011 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7954070493c4a5798a1f359afdaa6fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7954070493c4a5798a1f359afdaa6fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33017 } } }
I20260812 00:04:39.534364 28013 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7954070493c4a5798a1f359afdaa6fa. Latest consensus state: current_term: 1 leader_uuid: "d7954070493c4a5798a1f359afdaa6fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7954070493c4a5798a1f359afdaa6fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33017 } } }
I20260812 00:04:39.534512 28011 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:39.534521 28013 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:39.534721 28024 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 12 00:04:39 dist-test-slave-vpvm krb5kdc[27861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:04:39.535301 28024 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:39.537143 28024 catalog_manager.cc:1347] Generated new cluster ID: a0fff0e60aeb48e4aba03ebd046facce
I20260812 00:04:39.537199 28024 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:39.539470 28009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:39.527430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.27:33119 (local address 127.0.0.1:33017)
0812 00:04:39.527645 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:39.527656 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:39.527687 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:04:39.528170 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:39.528179 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:39.528237 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:39.528362 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:39.529471 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:39.530662 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:39.531938 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:39.532603 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:39.532733 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:39.535903 (+ 3170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:39.535909 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:39.535909 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:39.535924 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:39.537731 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:39.538244 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:39.538248 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:39.538249 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:39.538341 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:39.538557 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:39.538557 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:39.538558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:39.538828 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:39.539008 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:39.539134 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 00:04:39.539243 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":100,"threads_started":1}
I20260812 00:04:39.540473 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:39.548450 28009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:39.541980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.27:59655 (local address 127.0.0.1:33017)
0812 00:04:39.542024 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:39.542026 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:39.542157 (+ 131us) server_negotiation.cc:407] Connection header received
0812 00:04:39.542214 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:39.542215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:39.542225 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:39.542271 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:39.542798 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:39.543415 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:39.544132 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:39.544379 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:39.544437 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:39.545891 (+ 1454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:39.545893 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:39.545893 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:39.545901 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:39.547304 (+ 1403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:39.547664 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:39.547665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:39.547666 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:39.547723 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:39.547913 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:39.547914 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:39.547914 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:39.548034 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:39.548143 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:39.548279 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 00:04:39.548344 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":20}
I20260812 00:04:39.552829 28024 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:39.553572 28024 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:39.560462 28024 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d7954070493c4a5798a1f359afdaa6fa: Generated new TSK 0
I20260812 00:04:39.560691 28024 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:39.571125 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 27887
W20260812 00:04:39.590127 27859 connection.cc:535] client connection to 127.0.0.1:33017 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33017): Connection reset by peer (error 104)
2026-08-12T00:04:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1496 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:39 dist-test-slave-vpvm krb5kdc[28046](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:39 dist-test-slave-vpvm krb5kdc[28046](info): set up 2 sockets
Aug 12 00:04:39 dist-test-slave-vpvm krb5kdc[28046](info): commencing operation
krb5kdc: starting...
W20260812 00:04:40.792652 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.188s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:40 dist-test-slave-vpvm krb5kdc[28046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493080, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:04:40.931210 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43085
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:41.019485 28070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:41.019757 28070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:41.019793 28070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:41.021086 28070 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:41.021150 28070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:41.021168 28070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:41.021185 28070 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:41.021200 28070 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:41.023696 28070 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:41.024041 28070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:41.024290 28070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:04:41.029668 28070 server_base.cc:1034] running on GCE node
W20260812 00:04:41.029610 28084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:41.029604 28082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:41.029610 28081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:41.030155 28070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:41.030469 28070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:41.031656 28070 hybrid_clock.cc:648] HybridClock initialized: now 1786493081031604 us; error 71 us; skew 500 ppm
Aug 12 00:04:41 dist-test-slave-vpvm krb5kdc[28046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493081, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:41.034665 28070 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:04:41.035357 28070 webserver.cc:460] Webserver started at http://127.0.0.1:41851/ using document root <none> and password file <none>
I20260812 00:04:41.035624 28070 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:41.035678 28070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:41.035813 28070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:41.037150 28070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "0c77062a35ed449f9f874caa9bbbc0b4"
format_stamp: "Formatted at 2026-08-12 00:04:41 on dist-test-slave-vpvm"
server_key: "eb11d0ba03f8dbd8b5915902d2e2b1ef"
server_key_iv: "7d8776b665a6d089481a2fc62c9d9031"
server_key_version: "encryptionkey@0"
I20260812 00:04:41.037540 28070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "0c77062a35ed449f9f874caa9bbbc0b4"
format_stamp: "Formatted at 2026-08-12 00:04:41 on dist-test-slave-vpvm"
server_key: "eb11d0ba03f8dbd8b5915902d2e2b1ef"
server_key_iv: "7d8776b665a6d089481a2fc62c9d9031"
server_key_version: "encryptionkey@0"
I20260812 00:04:41.039245 28070 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260812 00:04:41.040372 28093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:41.040593 28070 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:04:41.040697 28070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "0c77062a35ed449f9f874caa9bbbc0b4"
format_stamp: "Formatted at 2026-08-12 00:04:41 on dist-test-slave-vpvm"
server_key: "eb11d0ba03f8dbd8b5915902d2e2b1ef"
server_key_iv: "7d8776b665a6d089481a2fc62c9d9031"
server_key_version: "encryptionkey@0"
I20260812 00:04:41.040797 28070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:41.064360 28070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:41.066859 28070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:41.066990 28070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:41.071382 28070 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43085
I20260812 00:04:41.071420 28183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43085 every 8 connection(s)
I20260812 00:04:41.071795 28070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:41.072757 28184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:41.076087 28184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4: Bootstrap starting.
I20260812 00:04:41.077026 28184 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:41.077548 28184 log.cc:824] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:41.078814 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 28070
I20260812 00:04:41.078830 28184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4: No bootstrap required, opened a new log
I20260812 00:04:41.078958 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:41.079164 26013 external_mini_cluster.cc:1428] Setting key c13bfa9029d2f1f29fbb7328f8c89bc5
I20260812 00:04:41.081264 28184 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c77062a35ed449f9f874caa9bbbc0b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43085 } }
I20260812 00:04:41.081457 28184 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:41.081493 28184 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c77062a35ed449f9f874caa9bbbc0b4, State: Initialized, Role: FOLLOWER
I20260812 00:04:41.081657 28184 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c77062a35ed449f9f874caa9bbbc0b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43085 } }
I20260812 00:04:41.081750 28184 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:41.081789 28184 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:41.081846 28184 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:41.082711 28184 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c77062a35ed449f9f874caa9bbbc0b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43085 } }
I20260812 00:04:41.082837 28184 leader_election.cc:302] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c77062a35ed449f9f874caa9bbbc0b4; no voters:
I20260812 00:04:41.083070 28184 leader_election.cc:288] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:41.083114 28192 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:41.083287 28192 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c77062a35ed449f9f874caa9bbbc0b4, State: Running, Role: LEADER
I20260812 00:04:41.083395 28192 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c77062a35ed449f9f874caa9bbbc0b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43085 } }
I20260812 00:04:41.083456 28184 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:41.083809 28192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c77062a35ed449f9f874caa9bbbc0b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c77062a35ed449f9f874caa9bbbc0b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43085 } } }
I20260812 00:04:41.083895 28192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:41.084054 28192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c77062a35ed449f9f874caa9bbbc0b4. Latest consensus state: current_term: 1 leader_uuid: "0c77062a35ed449f9f874caa9bbbc0b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c77062a35ed449f9f874caa9bbbc0b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43085 } } }
I20260812 00:04:41.084122 28192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:41.084612 28199 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:41.085417 28199 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:41.087190 28189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:41.079886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.27:46629 (local address 127.0.0.1:43085)
0812 00:04:41.080176 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:41.080186 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:41.080218 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:04:41.081229 (+ 1011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:41.081239 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:41.081313 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:41.081464 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:41.081752 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:41.083194 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:41.084173 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:41.084809 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:41.084902 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:41.086277 (+ 1375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:41.086281 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:41.086282 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:41.086515 (+ 233us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:41.086558 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:41.086573 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:41.086670 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:41.086930 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 00:04:41.086960 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":142,"threads_started":1}
I20260812 00:04:41.088301 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:41.093568 28189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:41.089693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.27:33093 (local address 127.0.0.1:43085)
0812 00:04:41.089737 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:41.089739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:41.089794 (+ 55us) server_negotiation.cc:407] Connection header received
0812 00:04:41.089845 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:41.089847 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:41.089858 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:41.089925 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:41.090086 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:41.090833 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:41.091625 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:41.092425 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:41.092531 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:41.093315 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:41.093317 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:41.093317 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:41.093323 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:41.093341 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:41.093346 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:41.093411 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:41.093461 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 00:04:41.093476 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:04:41.094218 28199 catalog_manager.cc:1347] Generated new cluster ID: 1f1e6454a6154fa692083454be190066
I20260812 00:04:41.094275 28199 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:41.119287 28199 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:41.120043 28199 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:41.127810 28199 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c77062a35ed449f9f874caa9bbbc0b4: Generated new TSK 0
I20260812 00:04:41.128047 28199 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:41.139139 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 28070
W20260812 00:04:41.174417 28043 connection.cc:535] client connection to 127.0.0.1:43085 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43085): Connection reset by peer (error 104)
2026-08-12T00:04:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1584 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:41 dist-test-slave-vpvm krb5kdc[28231](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:41 dist-test-slave-vpvm krb5kdc[28231](info): set up 2 sockets
Aug 12 00:04:41 dist-test-slave-vpvm krb5kdc[28231](info): commencing operation
krb5kdc: starting...
W20260812 00:04:42.399367 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:42 dist-test-slave-vpvm krb5kdc[28231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:04:42.546999 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42251
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:42.642511 28249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:42.642825 28249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:42.642856 28249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:42.644310 28249 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:42.644379 28249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:42.644394 28249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:42.644407 28249 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:42.644418 28249 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:42.646258 28249 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42251
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:42.646680 28249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:42.646997 28249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:42.653142 28259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:42.653185 28256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:42.653185 28257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:42.653661 28249 server_base.cc:1034] running on GCE node
I20260812 00:04:42.654175 28249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:42.654537 28249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:42.655743 28249 hybrid_clock.cc:648] HybridClock initialized: now 1786493082655729 us; error 39 us; skew 500 ppm
Aug 12 00:04:42 dist-test-slave-vpvm krb5kdc[28231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493082, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:42.663106 28249 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:04:42.664026 28249 webserver.cc:460] Webserver started at http://127.0.0.1:44161/ using document root <none> and password file <none>
I20260812 00:04:42.664348 28249 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:42.664412 28249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:42.664562 28249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:42.666091 28249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "d9e5b1dbc4ad4ac3ae29ad0812542bc5"
format_stamp: "Formatted at 2026-08-12 00:04:42 on dist-test-slave-vpvm"
server_key: "2a8e443f4db3189f830b3b6fea62f141"
server_key_iv: "e7c88af74ec57da2ab476e611d585c84"
server_key_version: "encryptionkey@0"
I20260812 00:04:42.666527 28249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "d9e5b1dbc4ad4ac3ae29ad0812542bc5"
format_stamp: "Formatted at 2026-08-12 00:04:42 on dist-test-slave-vpvm"
server_key: "2a8e443f4db3189f830b3b6fea62f141"
server_key_iv: "e7c88af74ec57da2ab476e611d585c84"
server_key_version: "encryptionkey@0"
I20260812 00:04:42.668408 28249 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260812 00:04:42.669569 28268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:42.669788 28249 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:42.669896 28249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "d9e5b1dbc4ad4ac3ae29ad0812542bc5"
format_stamp: "Formatted at 2026-08-12 00:04:42 on dist-test-slave-vpvm"
server_key: "2a8e443f4db3189f830b3b6fea62f141"
server_key_iv: "e7c88af74ec57da2ab476e611d585c84"
server_key_version: "encryptionkey@0"
I20260812 00:04:42.670034 28249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:42.673996 28249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:42.677191 28249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:42.677430 28249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:42.683291 28249 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42251
I20260812 00:04:42.683375 28345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42251 every 8 connection(s)
I20260812 00:04:42.683866 28249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:42.684325 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 28249
I20260812 00:04:42.684449 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:42.684657 26013 external_mini_cluster.cc:1428] Setting key 00a46e15679932b5a9211145c048db6b
I20260812 00:04:42.686066 28347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:42.688740 28350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:42.685538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.27:42141 (local address 127.0.0.1:42251)
0812 00:04:42.685832 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:42.685865 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:42.685899 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:04:42.686789 (+ 890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:42.686801 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:42.686838 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:42.687002 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:42.688080 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:42.688085 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:42.688085 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:42.688090 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:42.688143 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:42.688159 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:42.688217 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:42.688459 (+ 242us) server_negotiation.cc:299] Negotiation successful
0812 00:04:42.688511 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":168,"threads_started":1}
I20260812 00:04:42.689996 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:42.690196 28347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5: Bootstrap starting.
I20260812 00:04:42.690944 28347 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:42.691213 28347 log.cc:824] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:42.694020 28347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5: No bootstrap required, opened a new log
I20260812 00:04:42.695791 28350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:42.693883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.27:38969 (local address 127.0.0.1:42251)
0812 00:04:42.693944 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:42.693984 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:42.694179 (+ 195us) server_negotiation.cc:407] Connection header received
0812 00:04:42.694301 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:42.694303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:42.694311 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:42.694348 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:42.695411 (+ 1063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:42.695414 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:42.695414 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:42.695442 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:42.695463 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:42.695468 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:42.695519 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:42.695626 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 00:04:42.695697 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:04:42.696799 28347 raft_consensus.cc:348] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9e5b1dbc4ad4ac3ae29ad0812542bc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42251 } }
I20260812 00:04:42.696964 28347 raft_consensus.cc:374] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:42.696995 28347 raft_consensus.cc:729] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9e5b1dbc4ad4ac3ae29ad0812542bc5, State: Initialized, Role: FOLLOWER
I20260812 00:04:42.697100 28347 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9e5b1dbc4ad4ac3ae29ad0812542bc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42251 } }
I20260812 00:04:42.697184 28347 raft_consensus.cc:388] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:42.697216 28347 raft_consensus.cc:482] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:42.697259 28347 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:42.698158 28347 raft_consensus.cc:504] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9e5b1dbc4ad4ac3ae29ad0812542bc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42251 } }
I20260812 00:04:42.698282 28347 leader_election.cc:302] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d9e5b1dbc4ad4ac3ae29ad0812542bc5; no voters:
I20260812 00:04:42.698474 28347 leader_election.cc:288] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:42.698542 28359 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:42.698712 28359 raft_consensus.cc:686] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5 [term 1 LEADER]: Becoming Leader. State: Replica: d9e5b1dbc4ad4ac3ae29ad0812542bc5, State: Running, Role: LEADER
I20260812 00:04:42.698805 28347 sys_catalog.cc:564] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:42.698814 28359 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9e5b1dbc4ad4ac3ae29ad0812542bc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42251 } }
I20260812 00:04:42.699307 28360 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d9e5b1dbc4ad4ac3ae29ad0812542bc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9e5b1dbc4ad4ac3ae29ad0812542bc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42251 } } }
I20260812 00:04:42.699401 28360 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:42.699574 28361 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9e5b1dbc4ad4ac3ae29ad0812542bc5. Latest consensus state: current_term: 1 leader_uuid: "d9e5b1dbc4ad4ac3ae29ad0812542bc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9e5b1dbc4ad4ac3ae29ad0812542bc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42251 } } }
I20260812 00:04:42.699640 28361 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:42.699640 28369 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:42.700278 28369 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:42.704581 28386 mvcc.cc:205] Tried to move back new op lower bound from 7317475666745147392 to 7317475666734997504. Current Snapshot: MvccSnapshot[applied={T|T < 7317475666745147392}]
I20260812 00:04:42.705206 28369 catalog_manager.cc:1347] Generated new cluster ID: 5b17943f3afd4eaf9aec459960053b90
I20260812 00:04:42.705273 28369 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:42.738519 28369 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:42.738799 28369 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:42.743093 28369 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d9e5b1dbc4ad4ac3ae29ad0812542bc5: Generated new TSK 0
I20260812 00:04:42.743376 28369 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:42.747589 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 28249
2026-08-12T00:04:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1581 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:42 dist-test-slave-vpvm krb5kdc[28391](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:42 dist-test-slave-vpvm krb5kdc[28391](info): set up 2 sockets
Aug 12 00:04:42 dist-test-slave-vpvm krb5kdc[28391](info): commencing operation
krb5kdc: starting...
W20260812 00:04:43.988443 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:44 dist-test-slave-vpvm krb5kdc[28391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:04:44.129458 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40073
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40073
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:44.228641 28410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:44.228914 28410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:44.228955 28410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:44.230362 28410 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:44.230420 28410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:44.230439 28410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:44.230456 28410 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:44.230471 28410 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:44.232259 28410 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40073
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:44.232584 28410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:44.232836 28410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:44.238276 28419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:44.238286 28417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:44.238500 28423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:44.238502 28410 server_base.cc:1034] running on GCE node
I20260812 00:04:44.238793 28410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:44.239137 28410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:44.240351 28410 hybrid_clock.cc:648] HybridClock initialized: now 1786493084240332 us; error 51 us; skew 500 ppm
Aug 12 00:04:44 dist-test-slave-vpvm krb5kdc[28391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493084, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:44.244117 28410 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:04:44.245173 28410 webserver.cc:460] Webserver started at http://127.0.0.1:45297/ using document root <none> and password file <none>
I20260812 00:04:44.245601 28410 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:44.245667 28410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:44.245810 28410 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:44.247076 28410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "2703f46444794bdabb7bd516ab9cffc2"
format_stamp: "Formatted at 2026-08-12 00:04:44 on dist-test-slave-vpvm"
server_key: "817f00b877b6e411d6de0651b1807f01"
server_key_iv: "06f14ddbbaf6a25d7124aaa5d87b9874"
server_key_version: "encryptionkey@0"
I20260812 00:04:44.247421 28410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "2703f46444794bdabb7bd516ab9cffc2"
format_stamp: "Formatted at 2026-08-12 00:04:44 on dist-test-slave-vpvm"
server_key: "817f00b877b6e411d6de0651b1807f01"
server_key_iv: "06f14ddbbaf6a25d7124aaa5d87b9874"
server_key_version: "encryptionkey@0"
I20260812 00:04:44.249354 28410 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 00:04:44.251523 28436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:44.251842 28410 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 00:04:44.251973 28410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "2703f46444794bdabb7bd516ab9cffc2"
format_stamp: "Formatted at 2026-08-12 00:04:44 on dist-test-slave-vpvm"
server_key: "817f00b877b6e411d6de0651b1807f01"
server_key_iv: "06f14ddbbaf6a25d7124aaa5d87b9874"
server_key_version: "encryptionkey@0"
I20260812 00:04:44.252075 28410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:44.269785 28410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:44.272589 28410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:44.272751 28410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:44.277638 28410 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40073
I20260812 00:04:44.277748 28518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40073 every 8 connection(s)
I20260812 00:04:44.278103 28410 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:44.279619 28520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:44.283079 28520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2: Bootstrap starting.
I20260812 00:04:44.283761 28520 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:44.284045 28520 log.cc:824] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:44.285560 28520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2: No bootstrap required, opened a new log
I20260812 00:04:44.286612 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 28410
I20260812 00:04:44.286765 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:44.286983 26013 external_mini_cluster.cc:1428] Setting key ab552a925d9cce3bfcf42c7b9baa552b
I20260812 00:04:44.288173 28520 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2703f46444794bdabb7bd516ab9cffc2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40073 } }
I20260812 00:04:44.288376 28520 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:44.288414 28520 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2703f46444794bdabb7bd516ab9cffc2, State: Initialized, Role: FOLLOWER
I20260812 00:04:44.288599 28520 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2703f46444794bdabb7bd516ab9cffc2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40073 } }
I20260812 00:04:44.288697 28520 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:44.288748 28520 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:44.288802 28520 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:44.290345 28520 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2703f46444794bdabb7bd516ab9cffc2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40073 } }
I20260812 00:04:44.290504 28520 leader_election.cc:302] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2703f46444794bdabb7bd516ab9cffc2; no voters:
I20260812 00:04:44.290728 28520 leader_election.cc:288] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:44.290766 28530 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:44.290877 28530 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2 [term 1 LEADER]: Becoming Leader. State: Replica: 2703f46444794bdabb7bd516ab9cffc2, State: Running, Role: LEADER
I20260812 00:04:44.291040 28520 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:44.290998 28530 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2703f46444794bdabb7bd516ab9cffc2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40073 } }
I20260812 00:04:44.291409 28530 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2703f46444794bdabb7bd516ab9cffc2. Latest consensus state: current_term: 1 leader_uuid: "2703f46444794bdabb7bd516ab9cffc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2703f46444794bdabb7bd516ab9cffc2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40073 } } }
I20260812 00:04:44.291482 28530 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:44.292052 28531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2703f46444794bdabb7bd516ab9cffc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2703f46444794bdabb7bd516ab9cffc2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40073 } } }
I20260812 00:04:44.292140 28531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2 [sys.catalog]: This master's current role is: LEADER
W20260812 00:04:44.293296 28549 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:04:44.293345 28549 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:04:44.293406 28541 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:44.293583 28541 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 00:04:44 dist-test-slave-vpvm krb5kdc[28391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:04:44.295229 28541 catalog_manager.cc:1347] Generated new cluster ID: 293d1615aaa24602ad809fb135da52a4
I20260812 00:04:44.295274 28541 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:44.300873 28529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:44.287764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.27:58857 (local address 127.0.0.1:40073)
0812 00:04:44.288001 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:44.288010 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:44.288043 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:04:44.288181 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:44.288188 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:44.288242 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:44.288386 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:44.289449 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:44.290498 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:44.291577 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:44.292011 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:44.292117 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:44.295453 (+ 3336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:44.295459 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:44.295459 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:44.295473 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:44.297859 (+ 2386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:44.298561 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:44.298566 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:44.298567 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:44.298746 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:44.299034 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:44.299035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:44.299035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:44.299445 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:44.299648 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:44.300320 (+ 672us) server_negotiation.cc:299] Negotiation successful
0812 00:04:44.300591 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":106,"threads_started":1}
I20260812 00:04:44.302601 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:44.313264 28541 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:44.313998 28541 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:44.315146 28529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:44.306355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.27:35799 (local address 127.0.0.1:40073)
0812 00:04:44.306411 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:44.306413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:44.306569 (+ 156us) server_negotiation.cc:407] Connection header received
0812 00:04:44.306837 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:44.306837 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:44.306849 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:44.306911 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:44.307715 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:44.308666 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:44.309817 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:44.310215 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:44.310261 (+ 46us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:44.311926 (+ 1665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:44.311928 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:44.311929 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:44.311938 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:44.313675 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:44.314325 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:44.314327 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:44.314327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:44.314388 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:44.314615 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:44.314616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:44.314617 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:44.314740 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:44.314832 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:44.314987 (+ 155us) server_negotiation.cc:299] Negotiation successful
0812 00:04:44.315053 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:04:44.317354 28541 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2703f46444794bdabb7bd516ab9cffc2: Generated new TSK 0
I20260812 00:04:44.317534 28541 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:44.322968 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 28410
W20260812 00:04:44.339622 28389 connection.cc:535] client connection to 127.0.0.1:40073 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40073): Connection reset by peer (error 104)
2026-08-12T00:04:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1583 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:44 dist-test-slave-vpvm krb5kdc[28570](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:44 dist-test-slave-vpvm krb5kdc[28570](info): set up 2 sockets
Aug 12 00:04:44 dist-test-slave-vpvm krb5kdc[28570](info): commencing operation
krb5kdc: starting...
W20260812 00:04:45.540997 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.187s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:45 dist-test-slave-vpvm krb5kdc[28570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:04:45.664479 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33081
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:45.760769 28590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:45.761159 28590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:45.761288 28590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:45.763857 28590 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:45.764050 28590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:45.764117 28590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:45.764133 28590 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:45.764146 28590 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:45.766686 28590 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33081
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:45.766981 28590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:45.767238 28590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:45.773155 28600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:45.773281 28596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:45.773155 28602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:45.773679 28590 server_base.cc:1034] running on GCE node
I20260812 00:04:45.773927 28590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:45.774309 28590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:45.775525 28590 hybrid_clock.cc:648] HybridClock initialized: now 1786493085775507 us; error 34 us; skew 500 ppm
Aug 12 00:04:45 dist-test-slave-vpvm krb5kdc[28570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493085, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:45.779403 28590 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:04:45.779911 28590 webserver.cc:460] Webserver started at http://127.0.0.1:35917/ using document root <none> and password file <none>
I20260812 00:04:45.780148 28590 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:45.780200 28590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:45.780335 28590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:45.781505 28590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "2c6046e1d26b4838b6d4dd6f0508248b"
format_stamp: "Formatted at 2026-08-12 00:04:45 on dist-test-slave-vpvm"
server_key: "1aff33a9f74858d0026892203cb6517e"
server_key_iv: "d7828da806ba8d1548eabf814f3a1639"
server_key_version: "encryptionkey@0"
I20260812 00:04:45.781876 28590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "2c6046e1d26b4838b6d4dd6f0508248b"
format_stamp: "Formatted at 2026-08-12 00:04:45 on dist-test-slave-vpvm"
server_key: "1aff33a9f74858d0026892203cb6517e"
server_key_iv: "d7828da806ba8d1548eabf814f3a1639"
server_key_version: "encryptionkey@0"
I20260812 00:04:45.783582 28590 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:04:45.784564 28610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:45.784914 28590 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:04:45.785029 28590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "2c6046e1d26b4838b6d4dd6f0508248b"
format_stamp: "Formatted at 2026-08-12 00:04:45 on dist-test-slave-vpvm"
server_key: "1aff33a9f74858d0026892203cb6517e"
server_key_iv: "d7828da806ba8d1548eabf814f3a1639"
server_key_version: "encryptionkey@0"
I20260812 00:04:45.785106 28590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:45.798656 28590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:45.801015 28590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:45.801168 28590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:45.805531 28590 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33081
I20260812 00:04:45.805617 28691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33081 every 8 connection(s)
I20260812 00:04:45.806010 28590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:45.806982 28692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:45.809449 28692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b: Bootstrap starting.
I20260812 00:04:45.810137 28692 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:45.810391 28692 log.cc:824] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:45.810927 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 28590
I20260812 00:04:45.811049 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:45.811187 28692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b: No bootstrap required, opened a new log
I20260812 00:04:45.811220 26013 external_mini_cluster.cc:1428] Setting key 30d51983dd6272fa2842b80a169c7b54
I20260812 00:04:45.814188 28692 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6046e1d26b4838b6d4dd6f0508248b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33081 } }
I20260812 00:04:45.814384 28692 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:45.814415 28692 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c6046e1d26b4838b6d4dd6f0508248b, State: Initialized, Role: FOLLOWER
I20260812 00:04:45.814543 28692 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6046e1d26b4838b6d4dd6f0508248b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33081 } }
I20260812 00:04:45.814642 28692 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:45.814675 28692 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:45.814725 28692 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:45.815395 28692 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6046e1d26b4838b6d4dd6f0508248b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33081 } }
I20260812 00:04:45.815507 28692 leader_election.cc:302] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c6046e1d26b4838b6d4dd6f0508248b; no voters:
I20260812 00:04:45.815732 28692 leader_election.cc:288] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:45.815838 28700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:45.816023 28700 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b [term 1 LEADER]: Becoming Leader. State: Replica: 2c6046e1d26b4838b6d4dd6f0508248b, State: Running, Role: LEADER
I20260812 00:04:45.816133 28700 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6046e1d26b4838b6d4dd6f0508248b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33081 } }
I20260812 00:04:45.816459 28700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c6046e1d26b4838b6d4dd6f0508248b. Latest consensus state: current_term: 1 leader_uuid: "2c6046e1d26b4838b6d4dd6f0508248b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6046e1d26b4838b6d4dd6f0508248b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33081 } } }
I20260812 00:04:45.816541 28700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:45.816009 28692 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:45.816735 28702 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c6046e1d26b4838b6d4dd6f0508248b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6046e1d26b4838b6d4dd6f0508248b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33081 } } }
I20260812 00:04:45.816824 28702 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:45.817143 28706 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:45.817673 28706 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:45.817932 28699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:45.811771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.27:55593 (local address 127.0.0.1:33081)
0812 00:04:45.811979 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:45.811989 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:45.812030 (+ 41us) server_negotiation.cc:407] Connection header received
0812 00:04:45.812604 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:45.812615 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:45.812685 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:45.812849 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:45.813090 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:45.814486 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:45.815348 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:45.815974 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:45.816091 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:45.816991 (+ 900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:45.816995 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:45.816996 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:45.817223 (+ 227us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:45.817267 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:45.817285 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:45.817610 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:45.817656 (+ 46us) server_negotiation.cc:299] Negotiation successful
0812 00:04:45.817690 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":92,"threads_started":1}
I20260812 00:04:45.819028 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:45.819480 28706 catalog_manager.cc:1347] Generated new cluster ID: e642f311337e4173982d132a13eec18f
I20260812 00:04:45.819545 28706 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:45.826282 28699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:45.820590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.27:55261 (local address 127.0.0.1:33081)
0812 00:04:45.820635 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:45.820637 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:45.822167 (+ 1530us) server_negotiation.cc:407] Connection header received
0812 00:04:45.822221 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:45.822223 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:45.822234 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:45.822301 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:45.822436 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:45.823191 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:45.824712 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:45.825027 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:45.825118 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:45.826008 (+ 890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:45.826009 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:45.826010 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:45.826016 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:45.826034 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:45.826047 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:45.826110 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:45.826176 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 00:04:45.826191 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:04:45.836220 28706 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:45.836756 28706 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:45.850004 28706 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c6046e1d26b4838b6d4dd6f0508248b: Generated new TSK 0
I20260812 00:04:45.850214 28706 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:45.857872 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 28590
W20260812 00:04:45.876699 28567 connection.cc:535] client connection to 127.0.0.1:33081 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33081): Connection reset by peer (error 104)
2026-08-12T00:04:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1536 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:45 dist-test-slave-vpvm krb5kdc[28743](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:45 dist-test-slave-vpvm krb5kdc[28743](info): set up 2 sockets
Aug 12 00:04:45 dist-test-slave-vpvm krb5kdc[28743](info): commencing operation
krb5kdc: starting...
W20260812 00:04:47.059020 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:47 dist-test-slave-vpvm krb5kdc[28743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:04:47.207633 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44943
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:47.302049 28766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:47.302307 28766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:47.302335 28766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:47.303580 28766 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:47.303632 28766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:47.303645 28766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:47.303658 28766 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:47.303671 28766 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:47.305271 28766 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44943
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:47.305545 28766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:47.305797 28766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:47.310838 28772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:47.310830 28774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:47.311115 28766 server_base.cc:1034] running on GCE node
W20260812 00:04:47.310856 28779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:47.311439 28766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:47.311739 28766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:47.312901 28766 hybrid_clock.cc:648] HybridClock initialized: now 1786493087312890 us; error 31 us; skew 500 ppm
Aug 12 00:04:47 dist-test-slave-vpvm krb5kdc[28743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493087, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:47.315575 28766 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:04:47.316069 28766 webserver.cc:460] Webserver started at http://127.0.0.1:42313/ using document root <none> and password file <none>
I20260812 00:04:47.316313 28766 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:47.316363 28766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:47.316499 28766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:47.317631 28766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "67fc039ccc63487d97cd5dabffb17c16"
format_stamp: "Formatted at 2026-08-12 00:04:47 on dist-test-slave-vpvm"
server_key: "9d1dfb589cbfbe40902a563754f039b9"
server_key_iv: "283137da5094e8f5bf227228d6afd3bc"
server_key_version: "encryptionkey@0"
I20260812 00:04:47.318045 28766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "67fc039ccc63487d97cd5dabffb17c16"
format_stamp: "Formatted at 2026-08-12 00:04:47 on dist-test-slave-vpvm"
server_key: "9d1dfb589cbfbe40902a563754f039b9"
server_key_iv: "283137da5094e8f5bf227228d6afd3bc"
server_key_version: "encryptionkey@0"
I20260812 00:04:47.319432 28766 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:04:47.320838 28791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:47.321164 28766 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260812 00:04:47.321286 28766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "67fc039ccc63487d97cd5dabffb17c16"
format_stamp: "Formatted at 2026-08-12 00:04:47 on dist-test-slave-vpvm"
server_key: "9d1dfb589cbfbe40902a563754f039b9"
server_key_iv: "283137da5094e8f5bf227228d6afd3bc"
server_key_version: "encryptionkey@0"
I20260812 00:04:47.321380 28766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:47.324955 28766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:47.327275 28766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:47.327451 28766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:47.331883 28766 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44943
I20260812 00:04:47.331992 28862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44943 every 8 connection(s)
I20260812 00:04:47.332284 28766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:47.333364 28863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:47.334527 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 28766
I20260812 00:04:47.334722 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:47.334961 26013 external_mini_cluster.cc:1428] Setting key b737d172b695946aba007c1d7eda1393
I20260812 00:04:47.336264 28863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16: Bootstrap starting.
I20260812 00:04:47.336961 28863 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:47.337328 28863 log.cc:824] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:47.338274 28863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16: No bootstrap required, opened a new log
I20260812 00:04:47.338363 28868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:47.335711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.27:35707 (local address 127.0.0.1:44943)
0812 00:04:47.335995 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:47.336010 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:47.336052 (+ 42us) server_negotiation.cc:407] Connection header received
0812 00:04:47.336758 (+ 706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:47.336845 (+ 87us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:47.336898 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:47.337099 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:47.337865 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:47.337869 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:47.337869 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:47.337874 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:47.337917 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:47.337928 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:47.338088 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:47.338126 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 00:04:47.338172 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":118,"threads_started":1}
I20260812 00:04:47.339404 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:47.340699 28863 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67fc039ccc63487d97cd5dabffb17c16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44943 } }
I20260812 00:04:47.340976 28863 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:47.341032 28863 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67fc039ccc63487d97cd5dabffb17c16, State: Initialized, Role: FOLLOWER
I20260812 00:04:47.341157 28863 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67fc039ccc63487d97cd5dabffb17c16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44943 } }
I20260812 00:04:47.341264 28863 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:47.341310 28863 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:47.341359 28863 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:47.342150 28868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:47.340887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.27:36213 (local address 127.0.0.1:44943)
0812 00:04:47.340932 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:47.340933 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:47.341067 (+ 134us) server_negotiation.cc:407] Connection header received
0812 00:04:47.341151 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:47.341152 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:47.341158 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:47.341215 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:47.341878 (+ 663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:47.341879 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:47.341880 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:47.341884 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:47.341902 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:47.341907 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:47.342006 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:47.342071 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 00:04:47.342086 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:04:47.342370 28863 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67fc039ccc63487d97cd5dabffb17c16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44943 } }
I20260812 00:04:47.342484 28863 leader_election.cc:302] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67fc039ccc63487d97cd5dabffb17c16; no voters:
I20260812 00:04:47.342674 28863 leader_election.cc:288] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:47.342707 28878 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:47.342896 28878 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16 [term 1 LEADER]: Becoming Leader. State: Replica: 67fc039ccc63487d97cd5dabffb17c16, State: Running, Role: LEADER
I20260812 00:04:47.343026 28863 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:47.343073 28878 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67fc039ccc63487d97cd5dabffb17c16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44943 } }
I20260812 00:04:47.343431 28878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67fc039ccc63487d97cd5dabffb17c16. Latest consensus state: current_term: 1 leader_uuid: "67fc039ccc63487d97cd5dabffb17c16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67fc039ccc63487d97cd5dabffb17c16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44943 } } }
I20260812 00:04:47.343510 28878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:47.343631 28879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67fc039ccc63487d97cd5dabffb17c16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67fc039ccc63487d97cd5dabffb17c16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44943 } } }
I20260812 00:04:47.343889 28879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:47.343878 28889 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:47.344544 28889 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:47.346302 28889 catalog_manager.cc:1347] Generated new cluster ID: 2db5a377aee84df393ad77313736a406
I20260812 00:04:47.346361 28889 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:47.354761 28889 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:47.355036 28889 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:47.364979 28889 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67fc039ccc63487d97cd5dabffb17c16: Generated new TSK 0
I20260812 00:04:47.365209 28889 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:47.368132 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 28766
2026-08-12T00:04:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1516 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:47 dist-test-slave-vpvm krb5kdc[28908](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:47 dist-test-slave-vpvm krb5kdc[28908](info): set up 2 sockets
Aug 12 00:04:47 dist-test-slave-vpvm krb5kdc[28908](info): commencing operation
krb5kdc: starting...
W20260812 00:04:48.567013 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:48 dist-test-slave-vpvm krb5kdc[28908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:04:48.688265 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:34835
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:37159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:34835
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:48.772466 28934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:48.772691 28934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:48.772715 28934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:48.773936 28934 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:48.774030 28934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:48.774044 28934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:48.774056 28934 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:48.774067 28934 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:48.775612 28934 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:37159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:34835
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:34835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28934
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:48.775849 28934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:48.776072 28934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:48.780777 28943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:48.780826 28944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:48.780828 28948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:48.780972 28934 server_base.cc:1034] running on GCE node
I20260812 00:04:48.781239 28934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:48.781522 28934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:48.782696 28934 hybrid_clock.cc:648] HybridClock initialized: now 1786493088782681 us; error 31 us; skew 500 ppm
Aug 12 00:04:48 dist-test-slave-vpvm krb5kdc[28908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493088, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:48.788466 28934 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:04:48.788959 28934 webserver.cc:460] Webserver started at http://127.25.103.126:45907/ using document root <none> and password file <none>
I20260812 00:04:48.789187 28934 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:48.789237 28934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:48.789374 28934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:48.790524 28934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "241a7d2235c74cfb97cb479eda1f4cb5"
format_stamp: "Formatted at 2026-08-12 00:04:48 on dist-test-slave-vpvm"
server_key: "99442f88012fcb4df8d23262ac531f37"
server_key_iv: "f88f0b8f88c694bc7013192d7c3a5d92"
server_key_version: "encryptionkey@0"
I20260812 00:04:48.790870 28934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "241a7d2235c74cfb97cb479eda1f4cb5"
format_stamp: "Formatted at 2026-08-12 00:04:48 on dist-test-slave-vpvm"
server_key: "99442f88012fcb4df8d23262ac531f37"
server_key_iv: "f88f0b8f88c694bc7013192d7c3a5d92"
server_key_version: "encryptionkey@0"
I20260812 00:04:48.792135 28934 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:04:48.792827 28959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:48.792994 28934 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:48.793071 28934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "241a7d2235c74cfb97cb479eda1f4cb5"
format_stamp: "Formatted at 2026-08-12 00:04:48 on dist-test-slave-vpvm"
server_key: "99442f88012fcb4df8d23262ac531f37"
server_key_iv: "f88f0b8f88c694bc7013192d7c3a5d92"
server_key_version: "encryptionkey@0"
I20260812 00:04:48.793134 28934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:48.809748 28934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:48.811619 28934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:48.811759 28934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:48.815860 28934 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:34835
I20260812 00:04:48.815904 29033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:34835 every 8 connection(s)
I20260812 00:04:48.816259 28934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:48.817103 29034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:48.819415 29034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5: Bootstrap starting.
I20260812 00:04:48.820014 29034 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:48.820250 29034 log.cc:824] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:48.820912 29034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5: No bootstrap required, opened a new log
I20260812 00:04:48.822610 29034 raft_consensus.cc:348] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "241a7d2235c74cfb97cb479eda1f4cb5" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 34835 } }
I20260812 00:04:48.822767 29034 raft_consensus.cc:374] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:48.822790 29034 raft_consensus.cc:729] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 241a7d2235c74cfb97cb479eda1f4cb5, State: Initialized, Role: FOLLOWER
I20260812 00:04:48.822896 29034 consensus_queue.cc:260] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "241a7d2235c74cfb97cb479eda1f4cb5" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 34835 } }
I20260812 00:04:48.822947 29034 raft_consensus.cc:388] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:48.822968 29034 raft_consensus.cc:482] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:48.823010 29034 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:48.823869 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 28934
I20260812 00:04:48.823894 29034 raft_consensus.cc:504] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "241a7d2235c74cfb97cb479eda1f4cb5" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 34835 } }
I20260812 00:04:48.823980 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:48.823976 29034 leader_election.cc:302] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 241a7d2235c74cfb97cb479eda1f4cb5; no voters:
I20260812 00:04:48.824132 29034 leader_election.cc:288] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:48.824155 26013 external_mini_cluster.cc:1428] Setting key b36e05a22b05e167d2f818488679351d
I20260812 00:04:48.824173 29037 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:48.824332 29037 raft_consensus.cc:686] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5 [term 1 LEADER]: Becoming Leader. State: Replica: 241a7d2235c74cfb97cb479eda1f4cb5, State: Running, Role: LEADER
I20260812 00:04:48.824414 29034 sys_catalog.cc:564] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:48.824442 29037 consensus_queue.cc:237] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "241a7d2235c74cfb97cb479eda1f4cb5" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 34835 } }
I20260812 00:04:48.824769 29038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "241a7d2235c74cfb97cb479eda1f4cb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "241a7d2235c74cfb97cb479eda1f4cb5" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 34835 } } }
I20260812 00:04:48.824847 29038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:48.825032 29039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 241a7d2235c74cfb97cb479eda1f4cb5. Latest consensus state: current_term: 1 leader_uuid: "241a7d2235c74cfb97cb479eda1f4cb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "241a7d2235c74cfb97cb479eda1f4cb5" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 34835 } } }
I20260812 00:04:48.825119 29039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:48.825139 29047 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:48.825685 29047 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:48.827435 29047 catalog_manager.cc:1347] Generated new cluster ID: 504e5c81258d4326b6720346e633c4f5
I20260812 00:04:48.827491 29047 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:04:48 dist-test-slave-vpvm krb5kdc[28908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:04:48.834308 29042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:48.824785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58299 (local address 127.25.103.126:34835)
0812 00:04:48.824988 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:48.824997 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:48.825032 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:04:48.825152 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:48.825160 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:48.825218 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:48.826127 (+ 909us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:48.826321 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:48.827648 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:48.828378 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:48.828821 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:48.828917 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:48.831251 (+ 2334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:48.831255 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:48.831255 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:48.831266 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:48.832728 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:48.833094 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:48.833097 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:48.833097 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:48.833199 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:48.833404 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:48.833405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:48.833405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:48.833671 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:48.833834 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:48.833993 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 00:04:48.834107 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":77,"threads_started":1}
I20260812 00:04:48.835207 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:48.838129 29047 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:48.838624 29047 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:48.843451 29042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:48.836503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59455 (local address 127.25.103.126:34835)
0812 00:04:48.836554 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:48.836556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:48.836693 (+ 137us) server_negotiation.cc:407] Connection header received
0812 00:04:48.836748 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:48.836749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:48.836759 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:48.836802 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:48.837300 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:48.837869 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:48.838974 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:48.839274 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:48.839344 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:48.840761 (+ 1417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:48.840762 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:48.840763 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:48.840769 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:48.842263 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:48.842673 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:48.842673 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:48.842674 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:48.842727 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:48.842916 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:48.842916 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:48.842916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:48.843035 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:48.843148 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:48.843282 (+ 134us) server_negotiation.cc:299] Negotiation successful
0812 00:04:48.843347 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:04:48.845567 29047 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 241a7d2235c74cfb97cb479eda1f4cb5: Generated new TSK 0
I20260812 00:04:48.845747 29047 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:48.852150 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 28934
W20260812 00:04:48.875196 28906 connection.cc:535] client connection to 127.25.103.126:34835 recv error: Network error: failed to read from TLS socket (remote: 127.25.103.126:34835): Connection reset by peer (error 104)
2026-08-12T00:04:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1482 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:48 dist-test-slave-vpvm krb5kdc[29074](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:48 dist-test-slave-vpvm krb5kdc[29074](info): set up 2 sockets
Aug 12 00:04:48 dist-test-slave-vpvm krb5kdc[29074](info): commencing operation
krb5kdc: starting...
W20260812 00:04:50.029984 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:50 dist-test-slave-vpvm krb5kdc[29074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493090, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:04:50.149174 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:39147
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:42759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:39147
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:50.229254 29095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:50.229463 29095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:50.229485 29095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:50.230600 29095 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:50.230638 29095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:50.230651 29095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:50.230662 29095 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:50.230674 29095 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:50.232128 29095 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:42759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:39147
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:39147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:50.232332 29095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:50.232507 29095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:50.237233 29105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:50.237241 29103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:50.237241 29102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:50.237268 29095 server_base.cc:1034] running on GCE node
I20260812 00:04:50.237668 29095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:50.237942 29095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:50.239120 29095 hybrid_clock.cc:648] HybridClock initialized: now 1786493090239111 us; error 29 us; skew 500 ppm
Aug 12 00:04:50 dist-test-slave-vpvm krb5kdc[29074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493090, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:50.241466 29095 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:04:50.241878 29095 webserver.cc:460] Webserver started at http://127.25.103.126:39139/ using document root <none> and password file <none>
I20260812 00:04:50.242098 29095 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:50.242143 29095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:50.242234 29095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:50.243260 29095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "f04ac0c6ba5c4e26917a6fd39f77928c"
format_stamp: "Formatted at 2026-08-12 00:04:50 on dist-test-slave-vpvm"
server_key: "2336d1fbfc32bbd62371136ae8314011"
server_key_iv: "137a1d6170f0b3dab72588bbaad45ec8"
server_key_version: "encryptionkey@0"
I20260812 00:04:50.243556 29095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "f04ac0c6ba5c4e26917a6fd39f77928c"
format_stamp: "Formatted at 2026-08-12 00:04:50 on dist-test-slave-vpvm"
server_key: "2336d1fbfc32bbd62371136ae8314011"
server_key_iv: "137a1d6170f0b3dab72588bbaad45ec8"
server_key_version: "encryptionkey@0"
I20260812 00:04:50.244743 29095 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 00:04:50.245447 29115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:50.245641 29095 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:50.245743 29095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "f04ac0c6ba5c4e26917a6fd39f77928c"
format_stamp: "Formatted at 2026-08-12 00:04:50 on dist-test-slave-vpvm"
server_key: "2336d1fbfc32bbd62371136ae8314011"
server_key_iv: "137a1d6170f0b3dab72588bbaad45ec8"
server_key_version: "encryptionkey@0"
I20260812 00:04:50.245815 29095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:50.269011 29095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:50.271149 29095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:50.271279 29095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:50.275247 29095 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:39147
I20260812 00:04:50.275303 29208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:39147 every 8 connection(s)
I20260812 00:04:50.275629 29095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:50.276561 29209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:50.279038 29209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c: Bootstrap starting.
I20260812 00:04:50.279655 29209 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:50.279942 29209 log.cc:824] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:50.280679 29209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c: No bootstrap required, opened a new log
I20260812 00:04:50.282375 29209 raft_consensus.cc:348] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f04ac0c6ba5c4e26917a6fd39f77928c" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39147 } }
I20260812 00:04:50.282537 29209 raft_consensus.cc:374] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:50.282564 29209 raft_consensus.cc:729] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f04ac0c6ba5c4e26917a6fd39f77928c, State: Initialized, Role: FOLLOWER
I20260812 00:04:50.282722 29209 consensus_queue.cc:260] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f04ac0c6ba5c4e26917a6fd39f77928c" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39147 } }
I20260812 00:04:50.282809 29209 raft_consensus.cc:388] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:50.282847 29209 raft_consensus.cc:482] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:50.282902 29209 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:50.283836 29209 raft_consensus.cc:504] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f04ac0c6ba5c4e26917a6fd39f77928c" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39147 } }
I20260812 00:04:50.283941 29209 leader_election.cc:302] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f04ac0c6ba5c4e26917a6fd39f77928c; no voters:
I20260812 00:04:50.284130 29209 leader_election.cc:288] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:50.284185 29214 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:50.284392 29214 raft_consensus.cc:686] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c [term 1 LEADER]: Becoming Leader. State: Replica: f04ac0c6ba5c4e26917a6fd39f77928c, State: Running, Role: LEADER
I20260812 00:04:50.284443 29209 sys_catalog.cc:564] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:50.284559 29214 consensus_queue.cc:237] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f04ac0c6ba5c4e26917a6fd39f77928c" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39147 } }
I20260812 00:04:50.284585 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 29095
I20260812 00:04:50.284706 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:50.284920 26013 external_mini_cluster.cc:1428] Setting key 091cfbd1d61891fc095b3940c21b6a3b
I20260812 00:04:50.285173 29216 sys_catalog.cc:455] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f04ac0c6ba5c4e26917a6fd39f77928c. Latest consensus state: current_term: 1 leader_uuid: "f04ac0c6ba5c4e26917a6fd39f77928c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f04ac0c6ba5c4e26917a6fd39f77928c" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39147 } } }
I20260812 00:04:50.285264 29216 sys_catalog.cc:458] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:50.285616 29215 sys_catalog.cc:455] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f04ac0c6ba5c4e26917a6fd39f77928c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f04ac0c6ba5c4e26917a6fd39f77928c" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 39147 } } }
I20260812 00:04:50.285739 29226 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:50.285775 29215 sys_catalog.cc:458] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:50.286352 29226 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:50.288360 29226 catalog_manager.cc:1347] Generated new cluster ID: 8776e5e9636245cb89cbc1cab48392a8
I20260812 00:04:50.288455 29226 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:50.290699 29236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:50.285483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60181 (local address 127.25.103.126:39147)
0812 00:04:50.285780 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:50.285789 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:50.285821 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:04:50.286057 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:50.286065 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:50.286125 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:50.286266 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:50.286519 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:50.287881 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:50.288792 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:50.289237 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:50.289345 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:50.290067 (+ 722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:50.290071 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:50.290072 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:50.290254 (+ 182us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:50.290289 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:50.290300 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:50.290389 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:50.290496 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 00:04:50.290527 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":85,"threads_started":1}
I20260812 00:04:50.291651 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:50.298398 29236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:50.293020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54997 (local address 127.25.103.126:39147)
0812 00:04:50.293060 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:50.293062 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:50.295011 (+ 1949us) server_negotiation.cc:407] Connection header received
0812 00:04:50.295040 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:50.295042 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:50.295053 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:50.295115 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:50.295353 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:50.296094 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:50.297112 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:50.297348 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:50.297411 (+ 63us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:50.298137 (+ 726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:50.298139 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:50.298139 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:50.298144 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:50.298161 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:50.298166 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:50.298224 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:50.298296 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 00:04:50.298309 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:04:50.303393 29226 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:50.303928 29226 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:50.308681 29226 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f04ac0c6ba5c4e26917a6fd39f77928c: Generated new TSK 0
I20260812 00:04:50.308859 29226 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:50.313071 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 29095
W20260812 00:04:50.331990 29070 connection.cc:535] client connection to 127.25.103.126:39147 recv error: Network error: failed to read from TLS socket (remote: 127.25.103.126:39147): Connection reset by peer (error 104)
2026-08-12T00:04:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1456 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:50 dist-test-slave-vpvm krb5kdc[29257](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:50 dist-test-slave-vpvm krb5kdc[29257](info): set up 2 sockets
Aug 12 00:04:50 dist-test-slave-vpvm krb5kdc[29257](info): commencing operation
krb5kdc: starting...
W20260812 00:04:51.482188 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:51 dist-test-slave-vpvm krb5kdc[29257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493091, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:04:51.600885 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:38657
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:38393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:38657
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:51.682441 29276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:51.682648 29276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:51.682672 29276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:51.683818 29276 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:51.683863 29276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:51.683876 29276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:51.683887 29276 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:51.683902 29276 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:51.685379 29276 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:38393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:38657
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:38657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:51.685618 29276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:51.685832 29276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:51.690915 29283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:51.690923 29282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:51.691074 29276 server_base.cc:1034] running on GCE node
W20260812 00:04:51.690928 29286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:51.691361 29276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:51.691697 29276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:51.692862 29276 hybrid_clock.cc:648] HybridClock initialized: now 1786493091692846 us; error 25 us; skew 500 ppm
Aug 12 00:04:51 dist-test-slave-vpvm krb5kdc[29257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493091, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:51.695392 29276 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:04:51.695824 29276 webserver.cc:460] Webserver started at http://127.25.103.126:35553/ using document root <none> and password file <none>
I20260812 00:04:51.696051 29276 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:51.696096 29276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:51.696188 29276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:51.697207 29276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "e5dccb41973b41ffb248d77e1a701ac6"
format_stamp: "Formatted at 2026-08-12 00:04:51 on dist-test-slave-vpvm"
server_key: "abf3e761d26f19bc1adb9784a99059d8"
server_key_iv: "1425224d89d309cfac7698b109624ab5"
server_key_version: "encryptionkey@0"
I20260812 00:04:51.697517 29276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "e5dccb41973b41ffb248d77e1a701ac6"
format_stamp: "Formatted at 2026-08-12 00:04:51 on dist-test-slave-vpvm"
server_key: "abf3e761d26f19bc1adb9784a99059d8"
server_key_iv: "1425224d89d309cfac7698b109624ab5"
server_key_version: "encryptionkey@0"
I20260812 00:04:51.698796 29276 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:04:51.699548 29298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:51.699752 29276 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:04:51.699847 29276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "e5dccb41973b41ffb248d77e1a701ac6"
format_stamp: "Formatted at 2026-08-12 00:04:51 on dist-test-slave-vpvm"
server_key: "abf3e761d26f19bc1adb9784a99059d8"
server_key_iv: "1425224d89d309cfac7698b109624ab5"
server_key_version: "encryptionkey@0"
I20260812 00:04:51.699906 29276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:51.703188 29276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:51.704883 29276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:51.704990 29276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:51.708871 29276 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:38657
I20260812 00:04:51.708904 29379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:38657 every 8 connection(s)
I20260812 00:04:51.709208 29276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:51.710246 29380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:51.712512 29380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6: Bootstrap starting.
I20260812 00:04:51.713080 29380 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:51.713346 29380 log.cc:824] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:51.714072 29380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6: No bootstrap required, opened a new log
I20260812 00:04:51.715656 29380 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5dccb41973b41ffb248d77e1a701ac6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 38657 } }
I20260812 00:04:51.715793 29380 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:51.715814 29380 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5dccb41973b41ffb248d77e1a701ac6, State: Initialized, Role: FOLLOWER
I20260812 00:04:51.715939 29380 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5dccb41973b41ffb248d77e1a701ac6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 38657 } }
I20260812 00:04:51.715999 29380 raft_consensus.cc:388] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:51.716023 29380 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:51.716068 29380 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:51.716301 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 29276
I20260812 00:04:51.716406 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:51.716598 26013 external_mini_cluster.cc:1428] Setting key 81d9cd4bf845339630f1bdae83ba73f2
I20260812 00:04:51.717031 29380 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5dccb41973b41ffb248d77e1a701ac6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 38657 } }
I20260812 00:04:51.717192 29380 leader_election.cc:302] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5dccb41973b41ffb248d77e1a701ac6; no voters:
I20260812 00:04:51.717356 29380 leader_election.cc:288] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:51.717403 29386 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:51.717581 29386 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6 [term 1 LEADER]: Becoming Leader. State: Replica: e5dccb41973b41ffb248d77e1a701ac6, State: Running, Role: LEADER
I20260812 00:04:51.717633 29380 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:51.717764 29386 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5dccb41973b41ffb248d77e1a701ac6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 38657 } }
I20260812 00:04:51.718163 29386 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5dccb41973b41ffb248d77e1a701ac6. Latest consensus state: current_term: 1 leader_uuid: "e5dccb41973b41ffb248d77e1a701ac6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5dccb41973b41ffb248d77e1a701ac6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 38657 } } }
I20260812 00:04:51.718169 29388 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e5dccb41973b41ffb248d77e1a701ac6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5dccb41973b41ffb248d77e1a701ac6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 38657 } } }
I20260812 00:04:51.718308 29386 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:51.718315 29388 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:51.718590 29391 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:51.718925 29384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:51.717049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60823 (local address 127.25.103.126:38657)
0812 00:04:51.717241 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:51.717250 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:51.717284 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:04:51.717405 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:51.717413 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:51.717445 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:51.717625 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:51.718296 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:51.718300 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:51.718301 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:51.718305 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:51.718349 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:51.718364 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:51.718642 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:51.718678 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 00:04:51.718723 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":89,"threads_started":1}
I20260812 00:04:51.719317 29391 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:51.720036 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:51.722496 29384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:51.721566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47415 (local address 127.25.103.126:38657)
0812 00:04:51.721602 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:51.721604 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:51.721672 (+ 68us) server_negotiation.cc:407] Connection header received
0812 00:04:51.721728 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:51.721728 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:51.721733 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:51.721777 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:51.722307 (+ 530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:51.722308 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:51.722308 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:51.722311 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:51.722325 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:51.722328 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:51.722365 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:51.722418 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 00:04:51.722428 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:04:51.726380 29391 catalog_manager.cc:1347] Generated new cluster ID: 3957524f1d054cfbac885cd970cc5f53
I20260812 00:04:51.726483 29391 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:51.739272 29391 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:51.739454 29391 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:51.743522 29391 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e5dccb41973b41ffb248d77e1a701ac6: Generated new TSK 0
I20260812 00:04:51.743705 29391 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:51.752600 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 29276
2026-08-12T00:04:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1443 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:51 dist-test-slave-vpvm krb5kdc[29426](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:51 dist-test-slave-vpvm krb5kdc[29426](info): set up 2 sockets
Aug 12 00:04:51 dist-test-slave-vpvm krb5kdc[29426](info): commencing operation
krb5kdc: starting...
W20260812 00:04:52.947122 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:53 dist-test-slave-vpvm krb5kdc[29426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:04:53.068288 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:45665
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:42525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:45665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:53.150497 29446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:53.150740 29446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:53.150774 29446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:53.151955 29446 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:53.151998 29446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:53.152017 29446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:53.152034 29446 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:53.152050 29446 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:53.153553 29446 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:42525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:45665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:45665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:53.153808 29446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:53.154053 29446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:53.158847 29456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:53.158855 29457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:53.159024 29446 server_base.cc:1034] running on GCE node
W20260812 00:04:53.158912 29459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:53.159315 29446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:53.159641 29446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:53.160799 29446 hybrid_clock.cc:648] HybridClock initialized: now 1786493093160777 us; error 35 us; skew 500 ppm
Aug 12 00:04:53 dist-test-slave-vpvm krb5kdc[29426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493093, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:53.163410 29446 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:04:53.163894 29446 webserver.cc:460] Webserver started at http://127.25.103.126:40827/ using document root <none> and password file <none>
I20260812 00:04:53.164131 29446 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:53.164180 29446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:53.164294 29446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:53.165392 29446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "12605018e9b74765b74a3f6ee5f2f50f"
format_stamp: "Formatted at 2026-08-12 00:04:53 on dist-test-slave-vpvm"
server_key: "02cbc91d0e67c3e19a235649e834e6ae"
server_key_iv: "888fa6dc5841e8a7b1131b029f64b50f"
server_key_version: "encryptionkey@0"
I20260812 00:04:53.165750 29446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "12605018e9b74765b74a3f6ee5f2f50f"
format_stamp: "Formatted at 2026-08-12 00:04:53 on dist-test-slave-vpvm"
server_key: "02cbc91d0e67c3e19a235649e834e6ae"
server_key_iv: "888fa6dc5841e8a7b1131b029f64b50f"
server_key_version: "encryptionkey@0"
I20260812 00:04:53.167145 29446 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:04:53.168001 29471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:53.168192 29446 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:53.168284 29446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "12605018e9b74765b74a3f6ee5f2f50f"
format_stamp: "Formatted at 2026-08-12 00:04:53 on dist-test-slave-vpvm"
server_key: "02cbc91d0e67c3e19a235649e834e6ae"
server_key_iv: "888fa6dc5841e8a7b1131b029f64b50f"
server_key_version: "encryptionkey@0"
I20260812 00:04:53.168351 29446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:53.189922 29446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:53.192227 29446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:53.192375 29446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:53.196448 29446 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:45665
I20260812 00:04:53.196576 29554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:45665 every 8 connection(s)
I20260812 00:04:53.196846 29446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:53.197731 29556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:53.200066 29556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f: Bootstrap starting.
I20260812 00:04:53.200641 29556 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:53.200901 29556 log.cc:824] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:53.201608 29556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f: No bootstrap required, opened a new log
I20260812 00:04:53.203521 29556 raft_consensus.cc:348] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12605018e9b74765b74a3f6ee5f2f50f" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45665 } }
I20260812 00:04:53.203743 29556 raft_consensus.cc:374] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:53.203802 29556 raft_consensus.cc:729] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12605018e9b74765b74a3f6ee5f2f50f, State: Initialized, Role: FOLLOWER
I20260812 00:04:53.204008 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 29446
I20260812 00:04:53.203981 29556 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12605018e9b74765b74a3f6ee5f2f50f" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45665 } }
I20260812 00:04:53.204066 29556 raft_consensus.cc:388] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:53.204107 29556 raft_consensus.cc:482] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:53.204118 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:53.204154 29556 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:53.204310 26013 external_mini_cluster.cc:1428] Setting key 28e1e337244de9cbb0097c63c21ecc84
I20260812 00:04:53.205196 29556 raft_consensus.cc:504] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12605018e9b74765b74a3f6ee5f2f50f" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45665 } }
I20260812 00:04:53.205287 29556 leader_election.cc:302] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 12605018e9b74765b74a3f6ee5f2f50f; no voters:
I20260812 00:04:53.205433 29556 leader_election.cc:288] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:53.205482 29561 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:53.205626 29561 raft_consensus.cc:686] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f [term 1 LEADER]: Becoming Leader. State: Replica: 12605018e9b74765b74a3f6ee5f2f50f, State: Running, Role: LEADER
I20260812 00:04:53.205699 29556 sys_catalog.cc:564] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:53.205749 29561 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12605018e9b74765b74a3f6ee5f2f50f" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45665 } }
I20260812 00:04:53.206198 29562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "12605018e9b74765b74a3f6ee5f2f50f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12605018e9b74765b74a3f6ee5f2f50f" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45665 } } }
I20260812 00:04:53.206283 29562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:53.206476 29566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12605018e9b74765b74a3f6ee5f2f50f. Latest consensus state: current_term: 1 leader_uuid: "12605018e9b74765b74a3f6ee5f2f50f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12605018e9b74765b74a3f6ee5f2f50f" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45665 } } }
I20260812 00:04:53.206529 29566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:53.206831 29576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:53.207430 29576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:53.209120 29576 catalog_manager.cc:1347] Generated new cluster ID: b7bbd29c3844479b96445fc93eec556d
I20260812 00:04:53.209175 29576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:04:53 dist-test-slave-vpvm krb5kdc[29426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:04:53.216919 29560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:53.204801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58541 (local address 127.25.103.126:45665)
0812 00:04:53.205012 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:53.205023 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:53.205049 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:04:53.205146 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:53.205152 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:53.205195 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:53.205309 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:53.206291 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:53.207799 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:53.208641 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:53.210168 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:53.210265 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:53.213094 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:53.213099 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:53.213100 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:53.213113 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:53.215118 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:53.215511 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:53.215514 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:53.215515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:53.215643 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:53.215814 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:53.215815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:53.215816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:53.216152 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:53.216318 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:53.216403 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 00:04:53.216687 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":107,"threads_started":1}
I20260812 00:04:53.217839 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:53.225284 29576 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:53.226042 29576 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:53.226282 29560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:53.219349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56165 (local address 127.25.103.126:45665)
0812 00:04:53.219393 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:53.219395 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:53.219552 (+ 157us) server_negotiation.cc:407] Connection header received
0812 00:04:53.219610 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:53.219610 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:53.219623 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:53.219665 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:53.220264 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:53.221009 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:53.222034 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:53.222325 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:53.222380 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:53.223694 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:53.223695 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:53.223696 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:53.223703 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:53.225098 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:53.225488 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:53.225489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:53.225489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:53.225545 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:53.225716 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:53.225717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:53.225717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:53.225876 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:53.226010 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:53.226110 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 00:04:53.226195 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":19}
I20260812 00:04:53.232908 29576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 12605018e9b74765b74a3f6ee5f2f50f: Generated new TSK 0
I20260812 00:04:53.233110 29576 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:53.238574 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 29446
2026-08-12T00:04:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1479 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:53 dist-test-slave-vpvm krb5kdc[29604](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:53 dist-test-slave-vpvm krb5kdc[29604](info): set up 2 sockets
Aug 12 00:04:53 dist-test-slave-vpvm krb5kdc[29604](info): commencing operation
krb5kdc: starting...
W20260812 00:04:54.414021 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:54 dist-test-slave-vpvm krb5kdc[29604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493094, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:04:54.538177 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:45355
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:33947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:45355
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:54.621439 29625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:54.621651 29625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:54.621673 29625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:54.622838 29625 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:54.622882 29625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:54.622895 29625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:54.622906 29625 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:54.622917 29625 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:54.624437 29625 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:33947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:45355
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:45355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:54.624675 29625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:54.624902 29625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:54.630159 29635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:54.630153 29634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:54.630159 29638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:54.630420 29625 server_base.cc:1034] running on GCE node
I20260812 00:04:54.630688 29625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:54.630960 29625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:54.632110 29625 hybrid_clock.cc:648] HybridClock initialized: now 1786493094632096 us; error 32 us; skew 500 ppm
Aug 12 00:04:54 dist-test-slave-vpvm krb5kdc[29604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493094, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:54.638314 29625 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:04:54.638885 29625 webserver.cc:460] Webserver started at http://127.25.103.126:37929/ using document root <none> and password file <none>
I20260812 00:04:54.639129 29625 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:54.639181 29625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:54.639315 29625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:54.640415 29625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "1483f51db8dd40d3b7e49d347f4b19b4"
format_stamp: "Formatted at 2026-08-12 00:04:54 on dist-test-slave-vpvm"
server_key: "16d41fcf294e2b090c2b1b7ef6e6de1f"
server_key_iv: "b1d2de3f4845401f7416bfaf91d35167"
server_key_version: "encryptionkey@0"
I20260812 00:04:54.640765 29625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "1483f51db8dd40d3b7e49d347f4b19b4"
format_stamp: "Formatted at 2026-08-12 00:04:54 on dist-test-slave-vpvm"
server_key: "16d41fcf294e2b090c2b1b7ef6e6de1f"
server_key_iv: "b1d2de3f4845401f7416bfaf91d35167"
server_key_version: "encryptionkey@0"
I20260812 00:04:54.642136 29625 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:04:54.642941 29647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:54.643101 29625 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:54.643201 29625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "1483f51db8dd40d3b7e49d347f4b19b4"
format_stamp: "Formatted at 2026-08-12 00:04:54 on dist-test-slave-vpvm"
server_key: "16d41fcf294e2b090c2b1b7ef6e6de1f"
server_key_iv: "b1d2de3f4845401f7416bfaf91d35167"
server_key_version: "encryptionkey@0"
I20260812 00:04:54.643270 29625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:54.659060 29625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:54.661405 29625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:54.661577 29625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:54.665670 29625 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:45355
I20260812 00:04:54.665709 29725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:45355 every 8 connection(s)
I20260812 00:04:54.666064 29625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:54.667006 29726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:54.669277 29726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4: Bootstrap starting.
I20260812 00:04:54.669835 29726 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:54.670148 29726 log.cc:824] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:54.670887 29726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4: No bootstrap required, opened a new log
I20260812 00:04:54.672494 29726 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1483f51db8dd40d3b7e49d347f4b19b4" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45355 } }
I20260812 00:04:54.672640 29726 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:54.672660 29726 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1483f51db8dd40d3b7e49d347f4b19b4, State: Initialized, Role: FOLLOWER
I20260812 00:04:54.672762 29726 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1483f51db8dd40d3b7e49d347f4b19b4" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45355 } }
I20260812 00:04:54.672816 29726 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:54.672847 29726 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:54.672886 29726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:54.673729 29726 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1483f51db8dd40d3b7e49d347f4b19b4" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45355 } }
I20260812 00:04:54.673797 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 29625
I20260812 00:04:54.673827 29726 leader_election.cc:302] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1483f51db8dd40d3b7e49d347f4b19b4; no voters:
I20260812 00:04:54.673911 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:54.674022 29726 leader_election.cc:288] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:54.674045 29729 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:54.674113 26013 external_mini_cluster.cc:1428] Setting key 3cfe35e50364012326013154dcccf435
I20260812 00:04:54.674153 29729 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4 [term 1 LEADER]: Becoming Leader. State: Replica: 1483f51db8dd40d3b7e49d347f4b19b4, State: Running, Role: LEADER
I20260812 00:04:54.674238 29729 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1483f51db8dd40d3b7e49d347f4b19b4" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45355 } }
I20260812 00:04:54.674286 29726 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:54.675446 29730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1483f51db8dd40d3b7e49d347f4b19b4. Latest consensus state: current_term: 1 leader_uuid: "1483f51db8dd40d3b7e49d347f4b19b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1483f51db8dd40d3b7e49d347f4b19b4" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45355 } } }
I20260812 00:04:54.675571 29730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:54.675786 29753 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:54.675770 29731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1483f51db8dd40d3b7e49d347f4b19b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1483f51db8dd40d3b7e49d347f4b19b4" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 45355 } } }
I20260812 00:04:54.675998 29731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:54.676337 29753 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:54.677932 29753 catalog_manager.cc:1347] Generated new cluster ID: b4f9662da41343c1934954ee3d69704c
I20260812 00:04:54.678014 29753 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:54.680087 29738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:54.674673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34381 (local address 127.25.103.126:45355)
0812 00:04:54.674840 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:54.674848 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:54.674873 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:04:54.674986 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:54.674994 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:54.675049 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:54.675203 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:54.675462 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:54.676982 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:54.678135 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:54.678620 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:54.678739 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:54.679425 (+ 686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:54.679430 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:54.679430 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:54.679640 (+ 210us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:54.679673 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:54.679684 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:54.679745 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:54.679823 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 00:04:54.679893 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":78,"threads_started":1}
I20260812 00:04:54.680951 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:54.689540 29738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:54.686288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55591 (local address 127.25.103.126:45355)
0812 00:04:54.686332 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:54.686334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:54.686683 (+ 349us) server_negotiation.cc:407] Connection header received
0812 00:04:54.686749 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:54.686750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:54.686762 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:54.686811 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:54.686975 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:54.687467 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:54.688415 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:54.688623 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:54.688684 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:54.689303 (+ 619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:54.689305 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:54.689305 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:54.689311 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:54.689326 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:54.689330 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:54.689377 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:54.689424 (+ 47us) server_negotiation.cc:299] Negotiation successful
0812 00:04:54.689454 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":22}
I20260812 00:04:54.697068 29753 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:54.697595 29753 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:54.700894 29753 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1483f51db8dd40d3b7e49d347f4b19b4: Generated new TSK 0
I20260812 00:04:54.701076 29753 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:54.710345 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 29625
2026-08-12T00:04:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1473 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:54 dist-test-slave-vpvm krb5kdc[29776](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:54 dist-test-slave-vpvm krb5kdc[29776](info): set up 2 sockets
Aug 12 00:04:54 dist-test-slave-vpvm krb5kdc[29776](info): commencing operation
krb5kdc: starting...
W20260812 00:04:55.894312 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:55 dist-test-slave-vpvm krb5kdc[29776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:04:56.027275 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:36383
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:38947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:36383
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:56.114883 29799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:56.115116 29799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:56.115142 29799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:56.116317 29799 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:56.116364 29799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:56.116376 29799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:56.116389 29799 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:56.116400 29799 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:56.117933 29799 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:38947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:36383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:36383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29799
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:56.118193 29799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:56.118412 29799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:56.123265 29817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:56.123260 29812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:56.123260 29809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:56.123564 29799 server_base.cc:1034] running on GCE node
I20260812 00:04:56.123796 29799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:56.124095 29799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:56.125262 29799 hybrid_clock.cc:648] HybridClock initialized: now 1786493096125240 us; error 33 us; skew 500 ppm
Aug 12 00:04:56 dist-test-slave-vpvm krb5kdc[29776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493096, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:56.127912 29799 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:04:56.128415 29799 webserver.cc:460] Webserver started at http://127.25.103.126:42129/ using document root <none> and password file <none>
I20260812 00:04:56.128633 29799 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:56.128683 29799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:56.128808 29799 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:56.129892 29799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "6ea7b46f0e984eea9efc008077ff64c6"
format_stamp: "Formatted at 2026-08-12 00:04:56 on dist-test-slave-vpvm"
server_key: "22acb64f29a266fbeb91323e527df42c"
server_key_iv: "a1df10589cb4f160b183be048cc0705e"
server_key_version: "encryptionkey@0"
I20260812 00:04:56.130295 29799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "6ea7b46f0e984eea9efc008077ff64c6"
format_stamp: "Formatted at 2026-08-12 00:04:56 on dist-test-slave-vpvm"
server_key: "22acb64f29a266fbeb91323e527df42c"
server_key_iv: "a1df10589cb4f160b183be048cc0705e"
server_key_version: "encryptionkey@0"
I20260812 00:04:56.131644 29799 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:56.132411 29827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:56.132577 29799 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:56.132685 29799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "6ea7b46f0e984eea9efc008077ff64c6"
format_stamp: "Formatted at 2026-08-12 00:04:56 on dist-test-slave-vpvm"
server_key: "22acb64f29a266fbeb91323e527df42c"
server_key_iv: "a1df10589cb4f160b183be048cc0705e"
server_key_version: "encryptionkey@0"
I20260812 00:04:56.132754 29799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:56.136369 29799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:56.138477 29799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:56.138625 29799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:56.143280 29799 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:36383
I20260812 00:04:56.143319 29909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:36383 every 8 connection(s)
I20260812 00:04:56.143637 29799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:56.144646 29912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:56.147173 29912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6: Bootstrap starting.
I20260812 00:04:56.147730 29912 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:56.147964 29912 log.cc:824] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:56.148664 29912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6: No bootstrap required, opened a new log
I20260812 00:04:56.150309 29912 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ea7b46f0e984eea9efc008077ff64c6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36383 } }
I20260812 00:04:56.150461 29912 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:56.150484 29912 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ea7b46f0e984eea9efc008077ff64c6, State: Initialized, Role: FOLLOWER
I20260812 00:04:56.150585 29912 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ea7b46f0e984eea9efc008077ff64c6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36383 } }
I20260812 00:04:56.150637 29912 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:56.150656 29912 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:56.150754 29912 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:56.151674 29912 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ea7b46f0e984eea9efc008077ff64c6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36383 } }
I20260812 00:04:56.151772 29912 leader_election.cc:302] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ea7b46f0e984eea9efc008077ff64c6; no voters:
I20260812 00:04:56.151930 29912 leader_election.cc:288] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:56.151993 29917 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:56.152199 29917 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6 [term 1 LEADER]: Becoming Leader. State: Replica: 6ea7b46f0e984eea9efc008077ff64c6, State: Running, Role: LEADER
I20260812 00:04:56.152197 29912 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:56.152340 29917 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ea7b46f0e984eea9efc008077ff64c6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36383 } }
I20260812 00:04:56.152786 29918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ea7b46f0e984eea9efc008077ff64c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ea7b46f0e984eea9efc008077ff64c6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36383 } } }
I20260812 00:04:56.152874 29918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:56.153077 29933 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:56.153061 29921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ea7b46f0e984eea9efc008077ff64c6. Latest consensus state: current_term: 1 leader_uuid: "6ea7b46f0e984eea9efc008077ff64c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ea7b46f0e984eea9efc008077ff64c6" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 36383 } } }
I20260812 00:04:56.153348 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 29799
I20260812 00:04:56.153458 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:56.153478 29921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:56.153650 26013 external_mini_cluster.cc:1428] Setting key 08869c6503884cd1c1bb18147857de06
I20260812 00:04:56.153677 29933 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:56.155246 29933 catalog_manager.cc:1347] Generated new cluster ID: 59b79331b19c4d80aad8517a3d75cdb9
I20260812 00:04:56.155303 29933 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:56.160228 29943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:56.154136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37145 (local address 127.25.103.126:36383)
0812 00:04:56.158118 (+ 3982us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:56.158142 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:56.158467 (+ 325us) server_negotiation.cc:407] Connection header received
0812 00:04:56.158649 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:56.158656 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:56.158696 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:56.158921 (+ 225us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:56.159614 (+ 693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:56.159618 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:56.159618 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:56.159623 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:56.159675 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:56.159687 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:56.159746 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:56.159973 (+ 227us) server_negotiation.cc:299] Negotiation successful
0812 00:04:56.160027 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3856,"thread_start_us":71,"threads_started":1}
I20260812 00:04:56.161115 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:56.165732 29933 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:56.165913 29933 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:56.167163 29943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:56.166039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53929 (local address 127.25.103.126:36383)
0812 00:04:56.166099 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:56.166101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:56.166224 (+ 123us) server_negotiation.cc:407] Connection header received
0812 00:04:56.166293 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:56.166294 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:56.166299 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:56.166353 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:56.166947 (+ 594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:56.166949 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:56.166949 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:04:56.166953 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:56.166971 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:04:56.166976 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:56.167027 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:56.167082 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 00:04:56.167096 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 00:04:56.171792 29933 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ea7b46f0e984eea9efc008077ff64c6: Generated new TSK 0
I20260812 00:04:56.171975 29933 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:56.177835 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 29799
2026-08-12T00:04:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1465 ms)
[----------] 18 tests from AuthTokenIssuingTest (26896 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:56 dist-test-slave-vpvm krb5kdc[29959](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:56 dist-test-slave-vpvm krb5kdc[29959](info): set up 2 sockets
Aug 12 00:04:56 dist-test-slave-vpvm krb5kdc[29959](info): commencing operation
krb5kdc: starting...
W20260812 00:04:57.370728 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:04:57 dist-test-slave-vpvm krb5kdc[29959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:04:57.496272 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:46627
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:36425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:46627,127.25.103.125:34529,127.25.103.124:42471
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:57.581162 29981 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:04:57.581404 29981 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:57.581432 29981 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:57.581458 29981 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:57.582674 29981 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:57.582718 29981 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:57.582737 29981 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:57.582753 29981 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:57.582769 29981 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:57.584287 29981 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:36425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:46627,127.25.103.125:34529,127.25.103.124:42471
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:46627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29981
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:57.584550 29981 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:57.584862 29981 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:57.589805 29992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:57.589821 29988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:57.589990 29981 server_base.cc:1034] running on GCE node
W20260812 00:04:57.589852 29989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:57.590297 29981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:57.590612 29981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:57.591775 29981 hybrid_clock.cc:648] HybridClock initialized: now 1786493097591754 us; error 33 us; skew 500 ppm
Aug 12 00:04:57 dist-test-slave-vpvm krb5kdc[29959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493097, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:57.594496 29981 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:04:57.594980 29981 webserver.cc:460] Webserver started at http://127.25.103.126:41119/ using document root <none> and password file <none>
I20260812 00:04:57.595189 29981 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:57.595239 29981 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:57.595367 29981 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:57.596452 29981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "bd9f8a76ea4e41a89a056a3a45220bf2"
format_stamp: "Formatted at 2026-08-12 00:04:57 on dist-test-slave-vpvm"
server_key: "413d123fcac11898a6ad8d935009e70d"
server_key_iv: "b5d165f285421f64ba80b7d79b761451"
server_key_version: "encryptionkey@0"
I20260812 00:04:57.596805 29981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "bd9f8a76ea4e41a89a056a3a45220bf2"
format_stamp: "Formatted at 2026-08-12 00:04:57 on dist-test-slave-vpvm"
server_key: "413d123fcac11898a6ad8d935009e70d"
server_key_iv: "b5d165f285421f64ba80b7d79b761451"
server_key_version: "encryptionkey@0"
I20260812 00:04:57.598171 29981 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:04:57.598939 30002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:57.599125 29981 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:57.599212 29981 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "bd9f8a76ea4e41a89a056a3a45220bf2"
format_stamp: "Formatted at 2026-08-12 00:04:57 on dist-test-slave-vpvm"
server_key: "413d123fcac11898a6ad8d935009e70d"
server_key_iv: "b5d165f285421f64ba80b7d79b761451"
server_key_version: "encryptionkey@0"
I20260812 00:04:57.599279 29981 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:57.625638 29981 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:57.627907 29981 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:57.628063 29981 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:57.632212 29981 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:46627
I20260812 00:04:57.632259 30087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:46627 every 8 connection(s)
I20260812 00:04:57.632614 29981 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:57.633504 30089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:57.635126 30089 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:04:57 dist-test-slave-vpvm krb5kdc[29959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493097, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:04:57.642417 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 29981
I20260812 00:04:57.642504 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:04:57.642663 26013 external_mini_cluster.cc:1428] Setting key 6b173815e0eb32b28c87a7b97a23cd27
I20260812 00:04:57.644158 30093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.635861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40706 (local address 127.25.103.126:46627)
0812 00:04:57.636012 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:57.636019 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:57.636095 (+ 76us) server_negotiation.cc:407] Connection header received
0812 00:04:57.636610 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:57.636612 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:57.636628 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:57.636710 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:57.637245 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.638122 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.638973 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.639292 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.639372 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.641349 (+ 1977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:57.641357 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:57.641357 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:57.641363 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:57.642746 (+ 1383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.643132 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.643134 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.643134 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.643209 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.643422 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.643422 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.643422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.643637 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:57.643698 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:57.643895 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 00:04:57.643987 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":73,"threads_started":1}
I20260812 00:04:57.644183 30092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.635817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:46627 (local address 127.0.0.1:40706)
0812 00:04:57.635974 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.636015 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:57.636498 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:57.636714 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:57.636716 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:57.636974 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:57.637138 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:57.637142 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.638203 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.638204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:57.638896 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:57.638899 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.639356 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.639357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:57.639409 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.639900 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:57.639908 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:57.641272 (+ 1364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:57.642807 (+ 1535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:57.642815 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:57.642817 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:57.643054 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:57.643259 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:57.643259 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:57.643260 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:57.643368 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:57.643695 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:57.643701 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:57.643772 (+ 71us) client_negotiation.cc:769] Sending connection context
0812 00:04:57.643859 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 00:04:57.644076 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":62,"thread_start_us":70,"threads_started":1}
I20260812 00:04:57.645181 30089 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:04:57.645514 30092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.645403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:34529 (local address 127.0.0.1:53280)
0812 00:04:57.645449 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.645494 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.125:34529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260812 00:04:57.645659 30008 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.103.125:34529: connect: Connection refused (error 111)
I20260812 00:04:57.646080 30092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.645995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:34529 (local address 127.0.0.1:53290)
0812 00:04:57.646028 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.646058 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.125:34529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260812 00:04:57.646186 30089 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.125:34529: Network error: Client connection negotiation failed: client connection to 127.25.103.125:34529: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.25.103.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.125.keytab.
Entry for principal kudu/127.25.103.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.125.keytab.
I20260812 00:04:57.668840 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.125:34529
--webserver_interface=127.25.103.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.125.keytab
--principal=kudu/127.25.103.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:36425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:46627,127.25.103.125:34529,127.25.103.124:42471
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:04:57.695415 30089 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } attempt: 1
I20260812 00:04:57.695992 30092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.695831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:34529 (local address 127.0.0.1:53304)
0812 00:04:57.695911 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.695957 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.125:34529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 00:04:57.696492 30092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.696336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:34529 (local address 127.0.0.1:53316)
0812 00:04:57.696406 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.696464 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.125:34529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 00:04:57.696600 30089 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.125:34529: Network error: Client connection negotiation failed: client connection to 127.25.103.125:34529: connect: Connection refused (error 111)
W20260812 00:04:57.751854 30098 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:04:57.752084 30098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:57.752103 30098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:57.752123 30098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:57.753238 30098 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:57.753276 30098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:57.753290 30098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:57.753301 30098 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:57.753312 30098 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:57.754767 30098 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:36425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:46627,127.25.103.125:34529,127.25.103.124:42471
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.125.keytab
--principal=kudu/127.25.103.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.125:34529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.103.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30098
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:57.754968 30098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:57.755149 30098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:57.759873 30105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:57.759898 30112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:57.759936 30107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:57.760267 30098 server_base.cc:1034] running on GCE node
I20260812 00:04:57.760531 30098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:57.760803 30098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:57.761991 30098 hybrid_clock.cc:648] HybridClock initialized: now 1786493097761970 us; error 31 us; skew 500 ppm
Aug 12 00:04:57 dist-test-slave-vpvm krb5kdc[29959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493097, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:57.764657 30098 init.cc:377] Logged in from keytab as kudu/127.25.103.125@KRBTEST.COM (short username kudu)
I20260812 00:04:57.764767 30089 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } attempt: 2
I20260812 00:04:57.765139 30092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.765025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:34529 (local address 127.0.0.1:53318)
0812 00:04:57.765083 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.765111 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.125:34529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 00:04:57.765149 30098 webserver.cc:460] Webserver started at http://127.25.103.125:40539/ using document root <none> and password file <none>
I20260812 00:04:57.765389 30098 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:57.765442 30092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.765370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:34529 (local address 127.0.0.1:53330)
0812 00:04:57.765403 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.765424 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.125:34529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 00:04:57.765453 30098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260812 00:04:57.765523 30089 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.125:34529: Network error: Client connection negotiation failed: client connection to 127.25.103.125:34529: connect: Connection refused (error 111)
I20260812 00:04:57.765610 30098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:57.766743 30098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-1/data/instance:
uuid: "5406ce0ab5fc4429b338b55563c60332"
format_stamp: "Formatted at 2026-08-12 00:04:57 on dist-test-slave-vpvm"
server_key: "dc09c9a94658e640176f526518ebea54"
server_key_iv: "5bcdf8f420f188a8f82e299cde4cfd32"
server_key_version: "encryptionkey@0"
I20260812 00:04:57.767091 30098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-1/wal/instance:
uuid: "5406ce0ab5fc4429b338b55563c60332"
format_stamp: "Formatted at 2026-08-12 00:04:57 on dist-test-slave-vpvm"
server_key: "dc09c9a94658e640176f526518ebea54"
server_key_iv: "5bcdf8f420f188a8f82e299cde4cfd32"
server_key_version: "encryptionkey@0"
I20260812 00:04:57.768414 30098 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:04:57.769244 30121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:57.769409 30098 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:57.769493 30098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-1/wal
uuid: "5406ce0ab5fc4429b338b55563c60332"
format_stamp: "Formatted at 2026-08-12 00:04:57 on dist-test-slave-vpvm"
server_key: "dc09c9a94658e640176f526518ebea54"
server_key_iv: "5bcdf8f420f188a8f82e299cde4cfd32"
server_key_version: "encryptionkey@0"
I20260812 00:04:57.769584 30098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:57.779642 30098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:57.781646 30098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:57.781790 30098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:57.785918 30098 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.125:34529
I20260812 00:04:57.785998 30213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.125:34529 every 8 connection(s)
I20260812 00:04:57.786362 30098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-1/data/info.pb
I20260812 00:04:57.787206 30215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:57.788733 30215 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:04:57 dist-test-slave-vpvm krb5kdc[29959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493097, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.125@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:04:57.794552 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 30098
I20260812 00:04:57.794660 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-1/wal/instance
I20260812 00:04:57.794842 26013 external_mini_cluster.cc:1428] Setting key f623e3836c72cc6a3d45784f32c1c07e
I20260812 00:04:57.797457 30093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.789400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40716 (local address 127.25.103.126:46627)
0812 00:04:57.789444 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:57.789446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:57.789622 (+ 176us) server_negotiation.cc:407] Connection header received
0812 00:04:57.790169 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:57.790170 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:57.790181 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:57.790222 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:57.790798 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.791293 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.792213 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.792432 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.792501 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.794704 (+ 2203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:57.794706 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:57.794707 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:57.794716 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:57.795955 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.796505 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.796506 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.796506 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.796579 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.796833 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.796833 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.796833 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.796985 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:57.797050 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:57.797276 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 00:04:57.797362 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:04:57.797564 30218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.789356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:46627 (local address 127.0.0.1:40716)
0812 00:04:57.789517 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.789558 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:57.790067 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:57.790286 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:57.790289 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:57.790531 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:57.790731 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:57.790735 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.791352 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.791352 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:57.792131 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:57.792133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.792538 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.792540 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:57.792679 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.793121 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:57.793128 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:57.794578 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:57.796032 (+ 1454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:57.796041 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:57.796043 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:57.796411 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:57.796664 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:57.796664 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:57.796665 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:57.796776 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:57.797043 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:57.797046 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:57.797165 (+ 119us) client_negotiation.cc:769] Sending connection context
0812 00:04:57.797243 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 00:04:57.797370 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":66,"threads_started":1}
I20260812 00:04:57.798141 30215 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:04:57 dist-test-slave-vpvm krb5kdc[29959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493097, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.125@KRBTEST.COM for kudu/127.25.103.125@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.103.124@KRBTEST.COM; defaulting to no policy
I20260812 00:04:57.805069 30218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.798392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:34529 (local address 127.0.0.1:53334)
0812 00:04:57.798439 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.798450 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:57.798494 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:57.798711 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:57.798712 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:57.798852 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:57.798917 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:57.798919 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.799807 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.799808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:57.800579 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:57.800583 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.801000 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.801001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:57.801082 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.801422 (+ 340us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:57.801427 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:57.802712 (+ 1285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:57.804265 (+ 1553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:57.804266 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:57.804266 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:57.804420 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:57.804591 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:57.804591 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:57.804591 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:57.804635 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:57.804841 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:57.804842 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:57.804875 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 00:04:57.804917 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 00:04:57.804992 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 00:04:57.805148 30220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.798434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53334 (local address 127.25.103.125:34529)
0812 00:04:57.798580 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:57.798584 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:57.798602 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:04:57.798624 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:57.798626 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:57.798640 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:57.798698 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:57.798984 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.799713 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.800654 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.800938 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.800984 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.802782 (+ 1798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:57.802790 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:57.802791 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:57.802797 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:57.804174 (+ 1377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.804480 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.804483 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.804483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.804541 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.804675 (+ 134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.804676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.804676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.804799 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:57.804856 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:57.804940 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 00:04:57.805041 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":116,"thread_start_us":79,"threads_started":1}
I20260812 00:04:57.805742 30215 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.124@KRBTEST.COM" created.
I20260812 00:04:57.806108 30218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.805980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:42471 (local address 127.0.0.1:34340)
0812 00:04:57.806017 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.806083 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:42471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260812 00:04:57.807753 30123 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.103.124:42471: connect: Connection refused (error 111)
I20260812 00:04:57.808162 30218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.808073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:42471 (local address 127.0.0.1:34350)
0812 00:04:57.808113 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.808139 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:42471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 00:04:57.808257 30215 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.124:42471: Network error: Client connection negotiation failed: client connection to 127.25.103.124:42471: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.124.keytab.
Entry for principal kudu/127.25.103.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.124.keytab.
I20260812 00:04:57.820681 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.124:42471
--webserver_interface=127.25.103.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.124.keytab
--principal=kudu/127.25.103.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:36425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:46627,127.25.103.125:34529,127.25.103.124:42471
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:04:57.856664 30089 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } attempt: 3
I20260812 00:04:57.857463 30215 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } attempt: 1
I20260812 00:04:57.857817 30218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.857696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:42471 (local address 127.0.0.1:34354)
0812 00:04:57.857747 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.857781 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:42471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 00:04:57.858254 30218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.858048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:42471 (local address 127.0.0.1:34368)
0812 00:04:57.858200 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.858224 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:42471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":97,"threads_started":1}
W20260812 00:04:57.858327 30215 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.124:42471: Network error: Client connection negotiation failed: client connection to 127.25.103.124:42471: connect: Connection refused (error 111)
Aug 12 00:04:57 dist-test-slave-vpvm krb5kdc[29959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493097, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for kudu/127.25.103.125@KRBTEST.COM
I20260812 00:04:57.864219 30092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.857062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:34529 (local address 127.0.0.1:53346)
0812 00:04:57.857150 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.857168 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:57.857260 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:57.857401 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:57.857402 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:57.857608 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:57.857696 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:57.857698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.858591 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.858592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:57.859425 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:57.859429 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.859891 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.859892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:57.859987 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.860405 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:57.860410 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:57.861753 (+ 1343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:57.863361 (+ 1608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:57.863362 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:57.863363 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:57.863530 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:57.863704 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:57.863704 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:57.863705 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:57.863751 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:57.863983 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:57.863984 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:57.864024 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 00:04:57.864068 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:04:57.864149 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 00:04:57.864279 30220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.857132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53346 (local address 127.25.103.125:34529)
0812 00:04:57.857190 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:57.857191 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:57.857241 (+ 50us) server_negotiation.cc:407] Connection header received
0812 00:04:57.857318 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:57.857319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:57.857328 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:57.857375 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:57.857780 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.858512 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.859597 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.859824 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.859879 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.861839 (+ 1960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:57.861841 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:57.861841 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:57.861850 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:57.863275 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.863589 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.863590 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.863591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.863649 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.863796 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.863796 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.863797 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.863931 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:57.863993 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:57.864110 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 00:04:57.864188 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:04:57.864701 30089 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:04:57.865031 30092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.864941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:42471 (local address 127.0.0.1:34378)
0812 00:04:57.864983 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.865010 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:42471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 00:04:57.865358 30092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.865278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:42471 (local address 127.0.0.1:34394)
0812 00:04:57.865316 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.865339 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:42471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 00:04:57.865438 30089 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.124:42471: Network error: Client connection negotiation failed: client connection to 127.25.103.124:42471: connect: Connection refused (error 111)
I20260812 00:04:57.896595 30089 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } attempt: 1
I20260812 00:04:57.897111 30092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.896936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:42471 (local address 127.0.0.1:34404)
0812 00:04:57.897010 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.897070 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:42471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 00:04:57.897451 30092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.897362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:42471 (local address 127.0.0.1:34410)
0812 00:04:57.897400 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.897428 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:42471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 00:04:57.897547 30089 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.124:42471: Network error: Client connection negotiation failed: client connection to 127.25.103.124:42471: connect: Connection refused (error 111)
W20260812 00:04:57.906067 30224 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:04:57.906292 30224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:57.906308 30224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:57.906332 30224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:57.907514 30224 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:57.907562 30224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:57.907575 30224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:57.907586 30224 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:57.907598 30224 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:57.909085 30224 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:36425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:46627,127.25.103.125:34529,127.25.103.124:42471
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.124.keytab
--principal=kudu/127.25.103.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.124:42471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.103.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30224
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:04:57.909302 30224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:57.909494 30224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:57.914320 30233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:57.914320 30232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:57.914314 30236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:57.914503 30224 server_base.cc:1034] running on GCE node
I20260812 00:04:57.914817 30224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:57.915113 30224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:57.916265 30224 hybrid_clock.cc:648] HybridClock initialized: now 1786493097916252 us; error 30 us; skew 500 ppm
Aug 12 00:04:57 dist-test-slave-vpvm krb5kdc[29959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493097, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:57.918772 30224 init.cc:377] Logged in from keytab as kudu/127.25.103.124@KRBTEST.COM (short username kudu)
I20260812 00:04:57.919183 30224 webserver.cc:460] Webserver started at http://127.25.103.124:34769/ using document root <none> and password file <none>
I20260812 00:04:57.919384 30224 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:57.919425 30224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:57.919517 30224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:57.920570 30224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-2/data/instance:
uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6"
format_stamp: "Formatted at 2026-08-12 00:04:57 on dist-test-slave-vpvm"
server_key: "d39a26b87759ae6d868a5e0eace78b20"
server_key_iv: "29a94c98e77cb0db8182fb6ae1255916"
server_key_version: "encryptionkey@0"
I20260812 00:04:57.920890 30224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-2/wal/instance:
uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6"
format_stamp: "Formatted at 2026-08-12 00:04:57 on dist-test-slave-vpvm"
server_key: "d39a26b87759ae6d868a5e0eace78b20"
server_key_iv: "29a94c98e77cb0db8182fb6ae1255916"
server_key_version: "encryptionkey@0"
I20260812 00:04:57.922169 30224 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:04:57.922879 30249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:57.923066 30224 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:04:57.923166 30224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-2/wal
uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6"
format_stamp: "Formatted at 2026-08-12 00:04:57 on dist-test-slave-vpvm"
server_key: "d39a26b87759ae6d868a5e0eace78b20"
server_key_iv: "29a94c98e77cb0db8182fb6ae1255916"
server_key_version: "encryptionkey@0"
I20260812 00:04:57.923240 30224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:57.926457 30215 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } attempt: 2
I20260812 00:04:57.926921 30225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.926758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:42471 (local address 127.0.0.1:34424)
0812 00:04:57.926821 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.926873 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:42471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260812 00:04:57.927305 30225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.927223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:42471 (local address 127.0.0.1:34436)
0812 00:04:57.927264 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.927288 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:42471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 00:04:57.927395 30215 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.124:42471: Network error: Client connection negotiation failed: client connection to 127.25.103.124:42471: connect: Connection refused (error 111)
I20260812 00:04:57.947820 30224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:57.950140 30224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:57.950265 30224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:57.954401 30224 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.124:42471
I20260812 00:04:57.954470 30334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.124:42471 every 8 connection(s)
I20260812 00:04:57.954789 30224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-2/data/info.pb
I20260812 00:04:57.955709 30335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:57.956375 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 30224
I20260812 00:04:57.956465 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492802321514-26013-0/minicluster-data/master-2/wal/instance
I20260812 00:04:57.956636 26013 external_mini_cluster.cc:1428] Setting key f9b00c925d738447aca0742486cda10a
I20260812 00:04:57.957597 30335 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:04:57 dist-test-slave-vpvm krb5kdc[29959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493097, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.124@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
Aug 12 00:04:57 dist-test-slave-vpvm krb5kdc[29959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.124@KRBTEST.COM
I20260812 00:04:57.966794 30093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.958590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40730 (local address 127.25.103.126:46627)
0812 00:04:57.958640 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:57.958641 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:57.958772 (+ 131us) server_negotiation.cc:407] Connection header received
0812 00:04:57.958836 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:57.958837 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:57.958846 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:57.958903 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:57.959349 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.960059 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.961295 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.961604 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.961664 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.963903 (+ 2239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:57.963905 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:57.963905 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:57.963914 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:57.965244 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.965766 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.965767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.965767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.965825 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.966114 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.966114 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.966115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.966250 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:57.966314 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:57.966609 (+ 295us) server_negotiation.cc:299] Negotiation successful
0812 00:04:57.966697 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:04:57.966960 30340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.958502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:46627 (local address 127.0.0.1:40730)
0812 00:04:57.958658 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.958704 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:57.958783 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:57.958925 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:57.958927 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:57.959175 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:57.959266 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:57.959270 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.960156 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.960157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:57.961217 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:57.961219 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.961677 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.961678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:57.961749 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.962287 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:57.962297 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:57.963816 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:57.965333 (+ 1517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:57.965341 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:57.965343 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:57.965685 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:57.965888 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:57.965889 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:57.965889 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:57.966040 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:57.966321 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:57.966330 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:57.966474 (+ 144us) client_negotiation.cc:769] Sending connection context
0812 00:04:57.966580 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 00:04:57.966738 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":75,"threads_started":1}
I20260812 00:04:57.967555 30339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.957154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34442 (local address 127.25.103.124:42471)
0812 00:04:57.957424 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:57.957434 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:57.957466 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:04:57.957921 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:57.957930 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:57.958019 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:57.958164 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:57.958828 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.960032 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.961132 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.961527 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.961629 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.964588 (+ 2959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:57.964596 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:57.964597 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:57.964604 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:57.966228 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.966527 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.966530 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.966531 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.966587 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.966754 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.966755 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.966755 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.966919 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:57.967051 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:57.967381 (+ 330us) server_negotiation.cc:299] Negotiation successful
0812 00:04:57.967453 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":82,"threads_started":1}
I20260812 00:04:57.967661 30335 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:04:57 dist-test-slave-vpvm krb5kdc[29959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493097, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.124@KRBTEST.COM for kudu/127.25.103.125@KRBTEST.COM
Aug 12 00:04:57 dist-test-slave-vpvm krb5kdc[29959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:04:57.972685 30089 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } attempt: 2
I20260812 00:04:57.975247 30220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.967985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53354 (local address 127.25.103.125:34529)
0812 00:04:57.968035 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:57.968036 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:57.968044 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:04:57.968070 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:57.968071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:57.968080 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:57.968127 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:57.968403 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.968879 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.969529 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.969832 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.969913 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.972552 (+ 2639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:57.972553 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:57.972553 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:57.972560 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:57.974061 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.974389 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.974390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.974390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.974456 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.974676 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.974677 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.974678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.974813 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:57.974873 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:57.975069 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 00:04:57.975149 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:04:57.975329 30093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.968264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40742 (local address 127.25.103.126:46627)
0812 00:04:57.968301 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:57.968303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:57.968359 (+ 56us) server_negotiation.cc:407] Connection header received
0812 00:04:57.968443 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:57.968444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:57.968453 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:57.968497 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:57.968933 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.969385 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.970047 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.970294 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.970356 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.972632 (+ 2276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:57.972633 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:57.972653 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:57.972660 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:57.974278 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.974620 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.974621 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.974621 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.974674 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.974859 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.974860 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.974860 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.974970 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:57.975144 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:57.975180 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 00:04:57.975246 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:04:57.975857 30340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.967906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:34529 (local address 127.0.0.1:53354)
0812 00:04:57.967966 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.967978 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:57.968022 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:57.968144 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:57.968145 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:57.968277 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:57.968346 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:57.968347 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.968954 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.968955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:57.969453 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:57.969454 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.969925 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.969926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:57.970038 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.970414 (+ 376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:57.970418 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:57.972445 (+ 2027us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:57.974129 (+ 1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:57.974130 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:57.974131 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:57.974293 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:57.974530 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:57.974531 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:57.974532 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:57.974592 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:57.974899 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:57.974900 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:57.974943 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 00:04:57.975660 (+ 717us) client_negotiation.cc:240] Negotiation successful
0812 00:04:57.975763 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 00:04:57.976447 30335 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:04:57 dist-test-slave-vpvm krb5kdc[29959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493097, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for kudu/127.25.103.124@KRBTEST.COM
I20260812 00:04:57.980418 30339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.973185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34450 (local address 127.25.103.124:42471)
0812 00:04:57.973226 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:57.973228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:57.973236 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:04:57.973257 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:57.973257 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:57.973267 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:57.973685 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:57.974025 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.974715 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.975635 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.975934 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.976026 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.977863 (+ 1837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:57.977864 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:57.977864 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:57.977871 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:57.979408 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.979713 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.979715 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.979715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.979766 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.979943 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.979943 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.979944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.980067 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:57.980125 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:57.980261 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 00:04:57.980329 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:04:57.980422 30092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.972932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:42471 (local address 127.0.0.1:34450)
0812 00:04:57.972979 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.972989 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:57.973023 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:57.973704 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:57.973705 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:57.973878 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:57.973924 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:57.973926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.974786 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.974787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:57.975548 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:57.975552 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.976034 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.976035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:57.976104 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.976442 (+ 338us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:57.976446 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:57.977777 (+ 1331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:57.979493 (+ 1716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:57.979494 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:57.979495 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:57.979654 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:57.979818 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:57.979819 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:57.979819 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:57.979875 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:57.980121 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:57.980122 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:57.980168 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 00:04:57.980237 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 00:04:57.980328 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
Aug 12 00:04:57 dist-test-slave-vpvm krb5kdc[29959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.125@KRBTEST.COM
Aug 12 00:04:57 dist-test-slave-vpvm krb5kdc[29959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493097, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.124@KRBTEST.COM for kudu/127.25.103.124@KRBTEST.COM
I20260812 00:04:57.982657 30089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2: Bootstrap starting.
I20260812 00:04:57.983493 30089 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:57.983826 30089 log.cc:824] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:57.984208 30220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.975917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53360 (local address 127.25.103.125:34529)
0812 00:04:57.975950 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:57.975951 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:57.975960 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:04:57.975989 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:57.975990 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:57.975998 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:57.976036 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:57.976856 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.977401 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.978036 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.978319 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.978605 (+ 286us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.980955 (+ 2350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:57.980957 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:57.980957 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:57.980965 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:57.982606 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.982982 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.982983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.982984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.983045 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.983261 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.983262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.983263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.983395 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:57.984013 (+ 618us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:57.984051 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 00:04:57.984125 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:04:57.984213 30340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.976698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:42471 (local address 127.0.0.1:34458)
0812 00:04:57.976744 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:57.976752 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:57.976793 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:57.977256 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:57.977257 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:57.977390 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:57.977425 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:57.977426 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.978275 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.978275 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:57.978849 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:57.978851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.979874 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.979875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:57.979935 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.980314 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:57.980319 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:57.981550 (+ 1231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:57.983155 (+ 1605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:57.983156 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:57.983157 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:57.983341 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:57.983566 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:57.983567 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:57.983567 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:57.983625 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:57.983938 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:57.983938 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:57.983975 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 00:04:57.984029 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 00:04:57.984124 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 00:04:57.984526 30341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.976929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34458 (local address 127.25.103.124:42471)
0812 00:04:57.977132 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:57.977134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:57.977141 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:04:57.977159 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:57.977159 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:57.977168 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:57.977234 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:57.977518 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.978208 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.978918 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.979794 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.979875 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.981652 (+ 1777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:57.981653 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:57.981654 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:57.981660 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:57.983092 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.983414 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.983416 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.983416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.983480 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.983686 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.983687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.983688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.983855 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:57.983917 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:57.984321 (+ 404us) server_negotiation.cc:299] Negotiation successful
0812 00:04:57.984408 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":126,"threads_started":1}
I20260812 00:04:57.985116 30089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2: No bootstrap required, opened a new log
I20260812 00:04:57.985594 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:57.986690 30043 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40742
I20260812 00:04:57.987186 30335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6: Bootstrap starting.
I20260812 00:04:57.987151 30089 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } } peers { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } } peers { permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } }
I20260812 00:04:57.987294 30089 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9f8a76ea4e41a89a056a3a45220bf2, State: Initialized, Role: FOLLOWER
I20260812 00:04:57.987380 30089 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } } peers { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } } peers { permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } }
I20260812 00:04:57.987687 30349 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } } peers { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } } peers { permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } } }
I20260812 00:04:57.987728 30089 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:57.987742 30043 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 00:04:57.987819 30349 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:04:57.987859 30043 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:57.987897 30335 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:57.988144 30335 log.cc:824] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:57.988760 30043 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } } peers { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } } peers { permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } }
I20260812 00:04:57.988826 30335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6: No bootstrap required, opened a new log
I20260812 00:04:57.989014 30043 leader_election.cc:288] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [CANDIDATE]: Term 1 election: Requested vote from peers 5406ce0ab5fc4429b338b55563c60332 (127.25.103.125:34529), cf9c628c2b5d490bb9a161ee2d3f1eb6 (127.25.103.124:42471)
W20260812 00:04:57.990914 30367 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:04:57.990965 30367 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:04:57.990895 30335 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } } peers { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } } peers { permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } }
I20260812 00:04:57.991055 30335 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf9c628c2b5d490bb9a161ee2d3f1eb6, State: Initialized, Role: FOLLOWER
I20260812 00:04:57.991137 30335 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } } peers { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } } peers { permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } }
I20260812 00:04:57.991472 30335 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:57.993024 30288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6"
I20260812 00:04:57.994241 30288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6 [term 0 FOLLOWER]: Advancing to term 1
W20260812 00:04:57.994161 30392 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:04:57.994436 30392 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:04:57.995215 30288 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9f8a76ea4e41a89a056a3a45220bf2 in term 1.
I20260812 00:04:57.995585 30004 leader_election.cc:302] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9f8a76ea4e41a89a056a3a45220bf2, cf9c628c2b5d490bb9a161ee2d3f1eb6; no voters:
I20260812 00:04:57.995716 30349 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:57.995855 30349 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [term 1 LEADER]: Becoming Leader. State: Replica: bd9f8a76ea4e41a89a056a3a45220bf2, State: Running, Role: LEADER
I20260812 00:04:57.995957 30349 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } } peers { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } } peers { permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } }
I20260812 00:04:57.996416 30349 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd9f8a76ea4e41a89a056a3a45220bf2. Latest consensus state: current_term: 1 leader_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } } peers { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } } peers { permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } } }
I20260812 00:04:57.996513 30349 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:57.996737 30380 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } } peers { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } } peers { permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } } }
I20260812 00:04:57.996836 30380 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:04:57.991554 29981 master_runner.cc:186] Error getting master registration for 127.25.103.125:34529: OK, instance_id { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" instance_seqno: 1786493097784846 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:04:57.997519 29981 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:04:58.000325 30093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.990281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40752 (local address 127.25.103.126:46627)
0812 00:04:57.990321 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:57.990323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:57.990957 (+ 634us) server_negotiation.cc:407] Connection header received
0812 00:04:57.991274 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:57.991276 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:57.991303 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:57.991332 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:57.992116 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.992840 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.994169 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.994430 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:57.994487 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:57.996827 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:57.996829 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:57.996829 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:57.996836 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:57.998606 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.999180 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.999181 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.999182 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.999257 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:57.999543 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:57.999544 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:57.999545 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:57.999707 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:57.999809 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:58.000153 (+ 344us) server_negotiation.cc:299] Negotiation successful
0812 00:04:58.000237 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:04:57.998150 30224 master_runner.cc:186] Error getting master registration for 127.25.103.125:34529: OK, instance_id { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" instance_seqno: 1786493097784846 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:04:58.000420 30224 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:04:58.003602 30397 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:58.003878 30397 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:58.008456 30220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.990323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53366 (local address 127.25.103.125:34529)
0812 00:04:57.990365 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:57.990367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:57.995015 (+ 4648us) server_negotiation.cc:407] Connection header received
0812 00:04:57.995104 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:57.995106 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:57.995117 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:57.995146 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:57.998460 (+ 3314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:57.999184 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:58.002255 (+ 3071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:58.002572 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:58.002620 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:58.004793 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:58.004795 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:58.004795 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:58.004805 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:58.006642 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:58.007301 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:58.007303 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:58.007303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:58.007369 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:58.007838 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:58.007839 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:58.007839 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:58.007993 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:58.008073 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:58.008264 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 00:04:58.008355 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:04:58.010074 30341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:57.992848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34462 (local address 127.25.103.124:42471)
0812 00:04:57.992891 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:57.992892 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:57.995085 (+ 2193us) server_negotiation.cc:407] Connection header received
0812 00:04:57.995129 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:57.995131 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:57.995143 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:57.995198 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:58.000212 (+ 5014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:58.000943 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:58.002210 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:58.002545 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:58.002632 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:58.006703 (+ 4071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:58.006705 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:58.006705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:58.006714 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:58.008312 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:58.008891 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:58.008892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:58.008893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:58.008964 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:58.009257 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:58.009258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:58.009258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:58.009418 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:58.009516 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:58.009840 (+ 324us) server_negotiation.cc:299] Negotiation successful
0812 00:04:58.009931 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:04:58.010675 30288 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6 [term 1 FOLLOWER]: Refusing update from remote peer bd9f8a76ea4e41a89a056a3a45220bf2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:58.011214 30394 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:58.012610 30380 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd9f8a76ea4e41a89a056a3a45220bf2. Latest consensus state: current_term: 1 leader_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } } peers { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } } peers { permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } } }
I20260812 00:04:58.012719 30380 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:04:58.014098 30349 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } } peers { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } } peers { permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } } }
I20260812 00:04:58.014190 30349 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:58.014333 30380 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } } peers { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } } peers { permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } } }
I20260812 00:04:58.014413 30380 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:04:58.015074 30401 mvcc.cc:205] Tried to move back new op lower bound from 7317475729447612416 to 7317475729392304128. Current Snapshot: MvccSnapshot[applied={T|T < 7317475729447612416}]
I20260812 00:04:58.015177 30403 mvcc.cc:205] Tried to move back new op lower bound from 7317475729447612416 to 7317475729392304128. Current Snapshot: MvccSnapshot[applied={T|T < 7317475729447612416}]
I20260812 00:04:58.016008 30397 catalog_manager.cc:1347] Generated new cluster ID: 22213dd42c9843c3876c37d394c0103a
I20260812 00:04:58.016055 30397 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:58.018529 30215 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } attempt: 3
Aug 12 00:04:58 dist-test-slave-vpvm krb5kdc[29959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493097, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.125@KRBTEST.COM for kudu/127.25.103.124@KRBTEST.COM
I20260812 00:04:58.027133 30397 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:58.028564 30397 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:58.028926 30341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:58.018995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34478 (local address 127.25.103.124:42471)
0812 00:04:58.019032 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:58.019034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:58.019042 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:04:58.019061 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:58.019062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:58.019071 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:58.019121 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:58.019562 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:58.020345 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:58.021652 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:58.022063 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:58.022124 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:58.025613 (+ 3489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:58.025614 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:58.025615 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:58.025623 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:58.027399 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:58.027919 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:58.027920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:58.027920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:58.027977 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:58.028158 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:58.028158 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:58.028159 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:58.028283 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:58.028336 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:58.028752 (+ 416us) server_negotiation.cc:299] Negotiation successful
0812 00:04:58.028834 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:04:58.029227 30225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:58.018780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:42471 (local address 127.0.0.1:34478)
0812 00:04:58.018859 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:58.018869 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:58.018912 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:58.019177 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:58.019179 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:58.019397 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:58.019470 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:58.019472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:58.020679 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:58.020680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:58.021542 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:58.021544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:58.022200 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:58.022201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:58.022289 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:58.022887 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:58.022892 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:58.025531 (+ 2639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:58.027615 (+ 2084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:58.027616 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:58.027617 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:58.027842 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:58.028040 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:58.028041 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:58.028041 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:58.028099 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:58.028359 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:58.028360 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:58.028405 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 00:04:58.028461 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 00:04:58.028579 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 00:04:58.031522 30215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332: Bootstrap starting.
I20260812 00:04:58.032267 30215 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:58.032611 30215 log.cc:824] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:58.033502 30215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332: No bootstrap required, opened a new log
I20260812 00:04:58.035521 30215 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } } peers { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } } peers { permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } }
I20260812 00:04:58.035679 30215 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5406ce0ab5fc4429b338b55563c60332, State: Initialized, Role: FOLLOWER
I20260812 00:04:58.035754 30215 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } } peers { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } } peers { permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } }
I20260812 00:04:58.036098 30215 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:58.036185 30169 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:58.037161 30169 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332 [term 1 FOLLOWER]: Refusing update from remote peer bd9f8a76ea4e41a89a056a3a45220bf2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:58.037362 30170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5406ce0ab5fc4429b338b55563c60332"
I20260812 00:04:58.038041 30349 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:58.038208 30170 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9f8a76ea4e41a89a056a3a45220bf2 in term 1.
I20260812 00:04:58.040807 30415 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } } peers { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } } peers { permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } } }
I20260812 00:04:58.040982 30415 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:04:58.041088 30415 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd9f8a76ea4e41a89a056a3a45220bf2. Latest consensus state: current_term: 1 leader_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } } peers { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } } peers { permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } } }
I20260812 00:04:58.041188 30415 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:04:58.041253 30415 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } } peers { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } } peers { permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } } }
I20260812 00:04:58.041339 30415 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:04:58.045074 30397 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2: Generated new TSK 0
I20260812 00:04:58.045276 30397 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:58.046566 30427 mvcc.cc:205] Tried to move back new op lower bound from 7317475729507377152 to 7317475729392304128. Current Snapshot: MvccSnapshot[applied={T|T < 7317475729447612416}]
I20260812 00:04:58.046768 30394 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9f8a76ea4e41a89a056a3a45220bf2" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 46627 } } peers { permanent_uuid: "5406ce0ab5fc4429b338b55563c60332" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 34529 } } peers { permanent_uuid: "cf9c628c2b5d490bb9a161ee2d3f1eb6" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 42471 } } }
I20260812 00:04:58.046865 30394 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd9f8a76ea4e41a89a056a3a45220bf2 [sys.catalog]: This master's current role is: LEADER
W20260812 00:04:58.047535 30442 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:04:58.047650 30442 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 00:04:58.079178 30093 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:04:58.077406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40758 (local address 127.25.103.126:46627)
0812 00:04:58.077456 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:58.077458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:58.078439 (+ 981us) server_negotiation.cc:407] Connection header received
0812 00:04:58.078552 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:58.078553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:58.078564 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:58.078595 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:58.079084 (+ 489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40758: BlockingRecv error: recv got EOF from 127.0.0.1:40758 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260812 00:04:58.079983 30220 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:04:58.077717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53382 (local address 127.25.103.125:34529)
0812 00:04:58.077760 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:58.077762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:58.079434 (+ 1672us) server_negotiation.cc:407] Connection header received
0812 00:04:58.079535 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:58.079537 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:58.079549 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:58.079580 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:58.079918 (+ 338us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53382: BlockingRecv error: recv got EOF from 127.0.0.1:53382 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260812 00:04:58.080737 30341 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:04:58.078129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34482 (local address 127.25.103.124:42471)
0812 00:04:58.078177 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:58.078178 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:58.080239 (+ 2061us) server_negotiation.cc:407] Connection header received
0812 00:04:58.080332 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:58.080333 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:58.080344 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:58.080372 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:58.080678 (+ 306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34482: BlockingRecv error: recv got EOF from 127.0.0.1:34482 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260812 00:04:58.083065 30220 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:04:58.082405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53384 (local address 127.25.103.125:34529)
0812 00:04:58.082454 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:58.082456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:58.082560 (+ 104us) server_negotiation.cc:407] Connection header received
0812 00:04:58.082665 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:58.082666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:58.082686 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:58.082713 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:58.083013 (+ 300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53384: BlockingRecv error: recv got EOF from 127.0.0.1:53384 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260812 00:04:58.086218 30220 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:04:58.085352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53392 (local address 127.25.103.125:34529)
0812 00:04:58.085388 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:58.085390 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:58.085647 (+ 257us) server_negotiation.cc:407] Connection header received
0812 00:04:58.085744 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:58.085745 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:58.085756 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:58.085783 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:58.086169 (+ 386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53392: BlockingRecv error: recv got EOF from 127.0.0.1:53392 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 00:04:58.094888 30220 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:04:58.090284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53400 (local address 127.25.103.125:34529)
0812 00:04:58.090325 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:58.090327 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:58.094205 (+ 3878us) server_negotiation.cc:407] Connection header received
0812 00:04:58.094318 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:58.094320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:58.094331 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:58.094363 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:58.094827 (+ 464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53400: BlockingRecv error: recv got EOF from 127.0.0.1:53400 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 00:04:58.101109 30220 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:04:58.100217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53410 (local address 127.25.103.125:34529)
0812 00:04:58.100257 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:58.100259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:58.100516 (+ 257us) server_negotiation.cc:407] Connection header received
0812 00:04:58.100621 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:58.100622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:58.100635 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:58.100666 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:58.101039 (+ 373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53410: BlockingRecv error: recv got EOF from 127.0.0.1:53410 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 00:04:58.111899 30220 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:04:58.110559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53420 (local address 127.25.103.125:34529)
0812 00:04:58.110617 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:58.110619 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:58.111162 (+ 543us) server_negotiation.cc:407] Connection header received
0812 00:04:58.111271 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:58.111273 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:58.111286 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:58.111316 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:58.111836 (+ 520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53420: BlockingRecv error: recv got EOF from 127.0.0.1:53420 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 00:04:58.130487 30220 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:04:58.129442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53436 (local address 127.25.103.125:34529)
0812 00:04:58.129490 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:58.129492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:58.129795 (+ 303us) server_negotiation.cc:407] Connection header received
0812 00:04:58.129900 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:58.129901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:58.129913 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:58.129944 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:58.130422 (+ 478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53436: BlockingRecv error: recv got EOF from 127.0.0.1:53436 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 00:04:58.164757 30220 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:04:58.163955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53440 (local address 127.25.103.125:34529)
0812 00:04:58.164020 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:58.164022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:58.164124 (+ 102us) server_negotiation.cc:407] Connection header received
0812 00:04:58.164193 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:58.164194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:58.164206 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:58.164248 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:58.164693 (+ 445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53440: BlockingRecv error: recv got EOF from 127.0.0.1:53440 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260812 00:04:58.230715 30220 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:04:58.229993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53452 (local address 127.25.103.125:34529)
0812 00:04:58.230056 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:58.230058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:58.230171 (+ 113us) server_negotiation.cc:407] Connection header received
0812 00:04:58.230231 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:58.230232 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:58.230245 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:58.230293 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:58.230653 (+ 360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53452: BlockingRecv error: recv got EOF from 127.0.0.1:53452 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260812 00:04:58.360639 30220 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:04:58.359878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53462 (local address 127.25.103.125:34529)
0812 00:04:58.359949 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:58.359951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:58.360070 (+ 119us) server_negotiation.cc:407] Connection header received
0812 00:04:58.360134 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:58.360135 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:58.360148 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:58.360196 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:58.360572 (+ 376us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53462: BlockingRecv error: recv got EOF from 127.0.0.1:53462 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260812 00:04:58.618533 30220 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:04:58.617900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53464 (local address 127.25.103.125:34529)
0812 00:04:58.617985 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:58.617987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:58.618001 (+ 14us) server_negotiation.cc:407] Connection header received
0812 00:04:58.618060 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:58.618061 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:58.618073 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:58.618118 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:58.618471 (+ 353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53464: BlockingRecv error: recv got EOF from 127.0.0.1:53464 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 00:04:58.995177 30392 catalog_manager.cc:1259] Loaded cluster ID: 22213dd42c9843c3876c37d394c0103a
I20260812 00:04:58.995257 30392 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6: loading cluster ID for follower catalog manager: success
I20260812 00:04:58.996062 30392 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6: acquiring CA information for follower catalog manager: success
I20260812 00:04:58.996326 30392 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cf9c628c2b5d490bb9a161ee2d3f1eb6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:04:59.048120 30442 catalog_manager.cc:1259] Loaded cluster ID: 22213dd42c9843c3876c37d394c0103a
I20260812 00:04:59.048202 30442 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332: loading cluster ID for follower catalog manager: success
I20260812 00:04:59.049031 30442 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332: acquiring CA information for follower catalog manager: success
I20260812 00:04:59.049335 30442 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5406ce0ab5fc4429b338b55563c60332: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:04:59.134564 30542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:59.131735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54966 (local address 127.25.103.125:34529)
0812 00:04:59.131913 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:59.131915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:59.131927 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:04:59.131957 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:59.131958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:59.132019 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:59.132102 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:04:59.132263 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:59.132789 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:59.133613 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:59.133825 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:59.133885 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:59.134183 (+ 298us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:04:59.134308 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:04:59.134375 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:59.134462 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 00:04:59.134488 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":67,"threads_started":1}
I20260812 00:04:59.139195 30552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:59.136500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39666 (local address 127.25.103.124:42471)
0812 00:04:59.136615 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:59.136617 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:59.136664 (+ 47us) server_negotiation.cc:407] Connection header received
0812 00:04:59.136749 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:59.136750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:59.136799 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:59.136870 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:04:59.136987 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:59.137557 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:59.138337 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:59.138554 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:59.138611 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:59.138764 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:04:59.138886 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:04:59.138953 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:59.139066 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 00:04:59.139097 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":53,"threads_started":1}
I20260812 00:04:59.143705 30542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:59.141127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54980 (local address 127.25.103.125:34529)
0812 00:04:59.141186 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:59.141188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:59.141196 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:04:59.141221 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:59.141222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:59.141232 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:59.141282 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:04:59.141396 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:59.142051 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:59.142997 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:59.143283 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:59.143342 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:59.143472 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:04:59.143499 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:04:59.143532 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:59.143601 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 00:04:59.143622 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:04:59.144176 30552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:59.141151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39678 (local address 127.25.103.124:42471)
0812 00:04:59.141189 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:59.141190 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:59.141511 (+ 321us) server_negotiation.cc:407] Connection header received
0812 00:04:59.141564 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:59.141565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:59.141576 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:59.141626 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:04:59.141750 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:59.142466 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:59.143279 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:59.143556 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:59.143616 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:59.143899 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:04:59.143933 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:04:59.143986 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:59.144076 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 00:04:59.144104 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:04:59.144742 30563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:59.141026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52404 (local address 127.25.103.126:46627)
0812 00:04:59.141195 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:59.141197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:59.141205 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:04:59.141254 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:59.141255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:59.141307 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:59.141403 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:04:59.141565 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:59.142350 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:59.143661 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:59.144095 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:59.144156 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:59.144409 (+ 253us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:04:59.144514 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:04:59.144567 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:59.144651 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 00:04:59.144677 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":51,"threads_started":1}
I20260812 00:04:59.146471 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 29981
I20260812 00:04:59.160895 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 30098
I20260812 00:04:59.173096 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 30224
2026-08-12T00:04:59Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2994 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:59 dist-test-slave-vpvm krb5kdc[30567](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:59 dist-test-slave-vpvm krb5kdc[30567](info): set up 2 sockets
Aug 12 00:04:59 dist-test-slave-vpvm krb5kdc[30567](info): commencing operation
krb5kdc: starting...
W20260812 00:05:00.387452 26013 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/test-user.keytab.
Aug 12 00:05:00 dist-test-slave-vpvm krb5kdc[30567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.103.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
Entry for principal kudu/127.25.103.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab.
I20260812 00:05:00.535478 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:37707
--webserver_interface=127.25.103.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:37707,127.25.103.125:39329,127.25.103.124:36771
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:00.630745 30587 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:05:00.631001 30587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:00.631028 30587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:00.631062 30587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:00.632352 30587 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:00.632407 30587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:00.632434 30587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:00.632450 30587 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:00.632465 30587 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:00.634145 30587 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:37707,127.25.103.125:39329,127.25.103.124:36771
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.126.keytab
--principal=kudu/127.25.103.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.126:37707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.103.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:00.634516 30587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:00.634814 30587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:00.640764 30596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:00.640769 30597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:00.640866 30600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:00.640951 30587 server_base.cc:1034] running on GCE node
I20260812 00:05:00.641335 30587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:00.641644 30587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:00.642800 30587 hybrid_clock.cc:648] HybridClock initialized: now 1786493100642776 us; error 41 us; skew 500 ppm
Aug 12 00:05:00 dist-test-slave-vpvm krb5kdc[30567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493100, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:00.650363 30587 init.cc:377] Logged in from keytab as kudu/127.25.103.126@KRBTEST.COM (short username kudu)
I20260812 00:05:00.650925 30587 webserver.cc:460] Webserver started at http://127.25.103.126:44323/ using document root <none> and password file <none>
I20260812 00:05:00.651134 30587 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:00.651177 30587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:00.651275 30587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:00.652413 30587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-0/data/instance:
uuid: "8daa03e8ba6a402fbfc30f6abfb401a1"
format_stamp: "Formatted at 2026-08-12 00:05:00 on dist-test-slave-vpvm"
server_key: "582731011ee749d5221ade8c0780243f"
server_key_iv: "8c8a95b655995119ca7ec7e86b5e1025"
server_key_version: "encryptionkey@0"
I20260812 00:05:00.652750 30587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-0/wal/instance:
uuid: "8daa03e8ba6a402fbfc30f6abfb401a1"
format_stamp: "Formatted at 2026-08-12 00:05:00 on dist-test-slave-vpvm"
server_key: "582731011ee749d5221ade8c0780243f"
server_key_iv: "8c8a95b655995119ca7ec7e86b5e1025"
server_key_version: "encryptionkey@0"
I20260812 00:05:00.654187 30587 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:00.655145 30610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:00.655350 30587 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:00.655447 30587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-0/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-0/wal
uuid: "8daa03e8ba6a402fbfc30f6abfb401a1"
format_stamp: "Formatted at 2026-08-12 00:05:00 on dist-test-slave-vpvm"
server_key: "582731011ee749d5221ade8c0780243f"
server_key_iv: "8c8a95b655995119ca7ec7e86b5e1025"
server_key_version: "encryptionkey@0"
I20260812 00:05:00.655522 30587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:00.670373 30587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:00.672693 30587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:00.672858 30587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:00.677205 30587 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.126:37707
I20260812 00:05:00.677258 30702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.126:37707 every 8 connection(s)
I20260812 00:05:00.677752 30587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:00.679039 30704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:00.680691 30704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:05:00.682650 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 30587
I20260812 00:05:00.682742 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-0/wal/instance
I20260812 00:05:00.682930 26013 external_mini_cluster.cc:1428] Setting key 720d1b2b34cd63ff0830f4a62daa0e15
Aug 12 00:05:00 dist-test-slave-vpvm krb5kdc[30567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493100, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.103.125@KRBTEST.COM; defaulting to no policy
I20260812 00:05:00.692620 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.681496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38558 (local address 127.25.103.126:37707)
0812 00:05:00.681650 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:00.681659 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:00.681776 (+ 117us) server_negotiation.cc:407] Connection header received
0812 00:05:00.682449 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:00.682451 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:00.682469 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:00.682556 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:00.683270 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:00.684414 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:00.685525 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:00.685878 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:00.686022 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:00.688906 (+ 2884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:00.688915 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:00.688915 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:00.688925 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:00.690891 (+ 1966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:00.691365 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:00.691369 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:00.691369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:00.691456 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:00.691675 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:00.691676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:00.691677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:00.691929 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:00.692006 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:00.692244 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 00:05:00.692421 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":99,"thread_start_us":63,"threads_started":1}
I20260812 00:05:00.692759 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.681420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:37707 (local address 127.0.0.1:38558)
0812 00:05:00.681635 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.681685 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:00.682282 (+ 597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:00.682560 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:00.682562 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:00.682909 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:00.683168 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:00.683174 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:00.684594 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:00.684595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:00.685419 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:00.685423 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:00.685997 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:00.685998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:00.686072 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:00.686841 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:00.686852 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:00.688794 (+ 1942us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:00.691015 (+ 2221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:00.691024 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:00.691026 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:00.691281 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:00.691518 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:00.691519 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:00.691519 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:00.691618 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:00.691995 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:00.692001 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:00.692071 (+ 70us) client_negotiation.cc:769] Sending connection context
0812 00:05:00.692170 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 00:05:00.692588 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":194,"thread_start_us":106,"threads_started":1}
I20260812 00:05:00.693991 30704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.125@KRBTEST.COM" created.
I20260812 00:05:00.694522 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.694312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:39329 (local address 127.0.0.1:47678)
0812 00:05:00.694410 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.694484 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.125:39329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260812 00:05:00.694703 30611 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.103.125:39329: connect: Connection refused (error 111)
I20260812 00:05:00.695216 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.695111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:39329 (local address 127.0.0.1:47690)
0812 00:05:00.695160 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.695190 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.125:39329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 00:05:00.695333 30704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.125:39329: Network error: Client connection negotiation failed: client connection to 127.25.103.125:39329: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.125.keytab.
Entry for principal kudu/127.25.103.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.125.keytab.
I20260812 00:05:00.714183 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.125:39329
--webserver_interface=127.25.103.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.125.keytab
--principal=kudu/127.25.103.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:37707,127.25.103.125:39329,127.25.103.124:36771
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:05:00.744647 30704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } attempt: 1
I20260812 00:05:00.745524 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.745230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:39329 (local address 127.0.0.1:47694)
0812 00:05:00.745350 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.745478 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.125:39329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260812 00:05:00.746158 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.746006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:39329 (local address 127.0.0.1:47700)
0812 00:05:00.746067 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.746110 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.125:39329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 00:05:00.746325 30704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.125:39329: Network error: Client connection negotiation failed: client connection to 127.25.103.125:39329: connect: Connection refused (error 111)
W20260812 00:05:00.806285 30711 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:05:00.806550 30711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:00.806569 30711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:00.806593 30711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:00.807871 30711 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:00.807930 30711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:00.807943 30711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:00.807955 30711 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:00.807966 30711 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:00.810176 30711 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:37707,127.25.103.125:39329,127.25.103.124:36771
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.125.keytab
--principal=kudu/127.25.103.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.125:39329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.103.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:00.810595 30711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:00.810870 30711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:05:00.814546 30704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } attempt: 2
I20260812 00:05:00.815166 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.815026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:39329 (local address 127.0.0.1:47710)
0812 00:05:00.815084 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.815131 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.125:39329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 00:05:00.815490 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.815404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:39329 (local address 127.0.0.1:47722)
0812 00:05:00.815440 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.815468 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.125:39329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260812 00:05:00.815723 30704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.125:39329: Network error: Client connection negotiation failed: client connection to 127.25.103.125:39329: connect: Connection refused (error 111)
W20260812 00:05:00.817068 30717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:00.817286 30720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:00.817054 30716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:00.817425 30711 server_base.cc:1034] running on GCE node
I20260812 00:05:00.817816 30711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:00.818205 30711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:00.819384 30711 hybrid_clock.cc:648] HybridClock initialized: now 1786493100819363 us; error 35 us; skew 500 ppm
Aug 12 00:05:00 dist-test-slave-vpvm krb5kdc[30567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493100, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:00.822175 30711 init.cc:377] Logged in from keytab as kudu/127.25.103.125@KRBTEST.COM (short username kudu)
I20260812 00:05:00.822661 30711 webserver.cc:460] Webserver started at http://127.25.103.125:42971/ using document root <none> and password file <none>
I20260812 00:05:00.822904 30711 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:00.822956 30711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:00.823082 30711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:00.824236 30711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-1/data/instance:
uuid: "37d977f472be433097ae3d78ff4f0953"
format_stamp: "Formatted at 2026-08-12 00:05:00 on dist-test-slave-vpvm"
server_key: "6f5a5c94d274f9e6fd269e8d10964319"
server_key_iv: "7941911bcca40ab89cc1441cf0d565f0"
server_key_version: "encryptionkey@0"
I20260812 00:05:00.824581 30711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-1/wal/instance:
uuid: "37d977f472be433097ae3d78ff4f0953"
format_stamp: "Formatted at 2026-08-12 00:05:00 on dist-test-slave-vpvm"
server_key: "6f5a5c94d274f9e6fd269e8d10964319"
server_key_iv: "7941911bcca40ab89cc1441cf0d565f0"
server_key_version: "encryptionkey@0"
I20260812 00:05:00.826045 30711 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 00:05:00.826942 30733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:00.827171 30711 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:00.827275 30711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-1/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-1/wal
uuid: "37d977f472be433097ae3d78ff4f0953"
format_stamp: "Formatted at 2026-08-12 00:05:00 on dist-test-slave-vpvm"
server_key: "6f5a5c94d274f9e6fd269e8d10964319"
server_key_iv: "7941911bcca40ab89cc1441cf0d565f0"
server_key_version: "encryptionkey@0"
I20260812 00:05:00.827348 30711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:00.834982 30711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:00.838233 30711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:00.838438 30711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:00.843597 30711 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.125:39329
I20260812 00:05:00.843676 30814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.125:39329 every 8 connection(s)
I20260812 00:05:00.844254 30711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-1/data/info.pb
I20260812 00:05:00.845350 30816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:00.847121 30816 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:05:00.850979 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 30711
I20260812 00:05:00.851089 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-1/wal/instance
I20260812 00:05:00.851261 26013 external_mini_cluster.cc:1428] Setting key 457076bef85ed3ccd70cb4a73abc6933
Aug 12 00:05:00 dist-test-slave-vpvm krb5kdc[30567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493100, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.125@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:05:00.859579 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.847962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38564 (local address 127.25.103.126:37707)
0812 00:05:00.848026 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:00.848028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:00.848238 (+ 210us) server_negotiation.cc:407] Connection header received
0812 00:05:00.848786 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:00.848787 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:00.848805 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:00.848860 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:00.849858 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:00.850495 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:00.852049 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:00.852298 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:00.852366 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:00.855955 (+ 3589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:00.855958 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:00.855958 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:00.855969 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:00.857839 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:00.858497 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:00.858499 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:00.858499 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:00.858566 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:00.858810 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:00.858811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:00.858811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:00.858950 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:00.859011 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:00.859363 (+ 352us) server_negotiation.cc:299] Negotiation successful
0812 00:05:00.859479 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:05:00.859757 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.847916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:37707 (local address 127.0.0.1:38564)
0812 00:05:00.848115 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.848155 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:00.848684 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:00.848941 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:00.848945 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:00.849233 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:00.849652 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:00.849665 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:00.850607 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:00.850609 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:00.851902 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:00.851911 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:00.852392 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:00.852394 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:00.852563 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:00.853253 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:00.853272 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:00.855768 (+ 2496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:00.858027 (+ 2259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:00.858060 (+ 33us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:00.858064 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:00.858420 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:00.858626 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:00.858627 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:00.858627 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:00.858751 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:00.859011 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:00.859019 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:00.859192 (+ 173us) client_negotiation.cc:769] Sending connection context
0812 00:05:00.859297 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 00:05:00.859495 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":97,"threads_started":1}
I20260812 00:05:00.860329 30816 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.25.103.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.103.124@KRBTEST.COM" created.
Aug 12 00:05:00 dist-test-slave-vpvm krb5kdc[30567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493100, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.125@KRBTEST.COM for kudu/127.25.103.125@KRBTEST.COM
I20260812 00:05:00.869782 30821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.860670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47730 (local address 127.25.103.125:39329)
0812 00:05:00.860837 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:00.860841 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:00.860878 (+ 37us) server_negotiation.cc:407] Connection header received
0812 00:05:00.860932 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:00.860935 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:00.860948 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:00.861011 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:00.861303 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:00.862063 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:00.862760 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:00.863148 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:00.863237 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:00.866363 (+ 3126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:00.866387 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:00.866387 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:00.866395 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:00.868117 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:00.868679 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:00.868686 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:00.868686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:00.868855 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:00.869121 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:00.869122 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:00.869122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:00.869314 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:00.869442 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:00.869551 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 00:05:00.869643 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":99,"threads_started":1}
I20260812 00:05:00.869791 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.860621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:39329 (local address 127.0.0.1:47730)
0812 00:05:00.860817 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.860829 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:00.860879 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:00.861010 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:00.861011 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:00.861174 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:00.861236 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:00.861239 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:00.862150 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:00.862151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:00.862660 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:00.862661 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:00.863240 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:00.863241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:00.863331 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:00.863935 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:00.863940 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:00.866263 (+ 2323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:00.868225 (+ 1962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:00.868225 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:00.868226 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:00.868517 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:00.868975 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:00.868976 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:00.868976 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:00.869057 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:00.869391 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:00.869392 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:00.869434 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 00:05:00.869513 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 00:05:00.869708 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":80}
I20260812 00:05:00.871008 30816 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:05:00.871532 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.871335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36771 (local address 127.0.0.1:49790)
0812 00:05:00.871406 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.871480 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260812 00:05:00.871809 30738 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
I20260812 00:05:00.872385 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.872259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36771 (local address 127.0.0.1:49800)
0812 00:05:00.872322 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.872357 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 00:05:00.872570 30816 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.124:36771: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.103.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.124.keytab.
Entry for principal kudu/127.25.103.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.124.keytab.
I20260812 00:05:00.886152 26013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdkQn2d/build/release/bin/kudu
/tmp/dist-test-taskdkQn2d/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.124:36771
--webserver_interface=127.25.103.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.124.keytab
--principal=kudu/127.25.103.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.103.84:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.103.126:37707,127.25.103.125:39329,127.25.103.124:36771
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:05:00.906877 30704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } attempt: 3
Aug 12 00:05:00 dist-test-slave-vpvm krb5kdc[30567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493100, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for kudu/127.25.103.125@KRBTEST.COM
I20260812 00:05:00.916175 30821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.907414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47742 (local address 127.25.103.125:39329)
0812 00:05:00.907476 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:00.907479 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:00.907490 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:05:00.907521 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:00.907522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:00.907537 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:00.907616 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:00.907942 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:00.908725 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:00.909730 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:00.910123 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:00.910207 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:00.912896 (+ 2689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:00.912898 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:00.912898 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:00.912908 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:00.914734 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:00.915295 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:00.915298 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:00.915299 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:00.915398 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:00.915631 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:00.915631 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:00.915631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:00.915763 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:00.915821 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:00.916002 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 00:05:00.916093 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 00:05:00.916226 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.907325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:39329 (local address 127.0.0.1:47742)
0812 00:05:00.907393 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.907406 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:00.907457 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:00.907635 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:00.907635 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:00.907800 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:00.907874 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:00.907876 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:00.908901 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:00.908903 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:00.909593 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:00.909596 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:00.910242 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:00.910245 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:00.910354 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:00.911075 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:00.911082 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:00.912732 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:00.914895 (+ 2163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:00.914896 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:00.914897 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:00.915159 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:00.915492 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:00.915492 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:00.915493 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:00.915565 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:00.915827 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:00.915828 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:00.915903 (+ 75us) client_negotiation.cc:769] Sending connection context
0812 00:05:00.915977 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 00:05:00.916106 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 00:05:00.916955 30704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:05:00.917435 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.917299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36771 (local address 127.0.0.1:49804)
0812 00:05:00.917362 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.917402 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 00:05:00.917848 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.917639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36771 (local address 127.0.0.1:49814)
0812 00:05:00.917796 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.917822 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":116,"threads_started":1}
W20260812 00:05:00.917969 30704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.124:36771: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
I20260812 00:05:00.921891 30816 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } attempt: 1
I20260812 00:05:00.922706 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.922523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36771 (local address 127.0.0.1:49822)
0812 00:05:00.922599 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.922662 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 00:05:00.923167 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.923047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36771 (local address 127.0.0.1:49830)
0812 00:05:00.923094 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.923141 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 00:05:00.923382 30816 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.124:36771: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
I20260812 00:05:00.949180 30704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } attempt: 1
I20260812 00:05:00.949865 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.949722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36771 (local address 127.0.0.1:49834)
0812 00:05:00.949788 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.949830 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 00:05:00.950546 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.950366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36771 (local address 127.0.0.1:49846)
0812 00:05:00.950460 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.950499 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260812 00:05:00.950688 30704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.124:36771: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
W20260812 00:05:00.981130 30827 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:05:00.981377 30827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:00.981395 30827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:00.981424 30827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:00.982779 30827 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:00.982836 30827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:00.982848 30827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:00.982861 30827 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:00.982872 30827 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:00.984551 30827 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.103.84:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.103.126:37707,127.25.103.125:39329,127.25.103.124:36771
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/krb5kdc/kudu_127.25.103.124.keytab
--principal=kudu/127.25.103.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.103.124:36771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.103.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30827
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:00.984810 30827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:00.985074 30827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:00.990268 30835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:00.990350 30836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:00.990298 30838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:00.990602 30827 server_base.cc:1034] running on GCE node
I20260812 00:05:00.990877 30827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:00.991207 30827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:00.991604 30816 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } attempt: 2
I20260812 00:05:00.992029 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.991881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36771 (local address 127.0.0.1:49850)
0812 00:05:00.991946 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.991978 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 00:05:00.992401 30827 hybrid_clock.cc:648] HybridClock initialized: now 1786493100992407 us; error 79 us; skew 500 ppm
I20260812 00:05:00.992651 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:00.992434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36771 (local address 127.0.0.1:49858)
0812 00:05:00.992595 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:00.992625 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
W20260812 00:05:00.992777 30816 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.124:36771: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
Aug 12 00:05:00 dist-test-slave-vpvm krb5kdc[30567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493100, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:00.995884 30827 init.cc:377] Logged in from keytab as kudu/127.25.103.124@KRBTEST.COM (short username kudu)
I20260812 00:05:00.996496 30827 webserver.cc:460] Webserver started at http://127.25.103.124:40313/ using document root <none> and password file <none>
I20260812 00:05:00.996773 30827 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:00.996835 30827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:00.996997 30827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:00.998503 30827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-2/data/instance:
uuid: "b008f47556be4fdfb3074c7be11b3767"
format_stamp: "Formatted at 2026-08-12 00:05:00 on dist-test-slave-vpvm"
server_key: "49b80f5d80e4ca43bdfcdd7273d6cb46"
server_key_iv: "8e589c69c90e572ae9136de8ecc30a9c"
server_key_version: "encryptionkey@0"
I20260812 00:05:00.998914 30827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-2/wal/instance:
uuid: "b008f47556be4fdfb3074c7be11b3767"
format_stamp: "Formatted at 2026-08-12 00:05:00 on dist-test-slave-vpvm"
server_key: "49b80f5d80e4ca43bdfcdd7273d6cb46"
server_key_iv: "8e589c69c90e572ae9136de8ecc30a9c"
server_key_version: "encryptionkey@0"
I20260812 00:05:01.000600 30827 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:05:01.001612 30846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:01.001879 30827 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:01.002017 30827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-2/data,/tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-2/wal
uuid: "b008f47556be4fdfb3074c7be11b3767"
format_stamp: "Formatted at 2026-08-12 00:05:00 on dist-test-slave-vpvm"
server_key: "49b80f5d80e4ca43bdfcdd7273d6cb46"
server_key_iv: "8e589c69c90e572ae9136de8ecc30a9c"
server_key_version: "encryptionkey@0"
I20260812 00:05:01.002110 30827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:01.025841 30704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } attempt: 2
I20260812 00:05:01.026646 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:01.026456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36771 (local address 127.0.0.1:49866)
0812 00:05:01.026546 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:01.026609 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 00:05:01.027151 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:01.027046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36771 (local address 127.0.0.1:49868)
0812 00:05:01.027102 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:01.027132 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 00:05:01.027346 30704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.103.124:36771: Network error: Client connection negotiation failed: client connection to 127.25.103.124:36771: connect: Connection refused (error 111)
I20260812 00:05:01.043883 30827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:01.046321 30827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:01.046484 30827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:01.051046 30827 rpc_server.cc:307] RPC server started. Bound to: 127.25.103.124:36771
I20260812 00:05:01.051133 30932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.103.124:36771 every 8 connection(s)
I20260812 00:05:01.051546 30827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-2/data/info.pb
I20260812 00:05:01.052588 30933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:01.053490 26013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdkQn2d/build/release/bin/kudu as pid 30827
I20260812 00:05:01.053608 26013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdkQn2d/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492802321514-26013-0/minicluster-data/master-2/wal/instance
I20260812 00:05:01.053803 26013 external_mini_cluster.cc:1428] Setting key 63922577aacee06997d6f75859fce16c
I20260812 00:05:01.054704 30933 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:05:01 dist-test-slave-vpvm krb5kdc[30567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493100, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.124@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
Aug 12 00:05:01 dist-test-slave-vpvm krb5kdc[30567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.124@KRBTEST.COM
I20260812 00:05:01.065691 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:01.055966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38580 (local address 127.25.103.126:37707)
0812 00:05:01.056033 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.056035 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.056166 (+ 131us) server_negotiation.cc:407] Connection header received
0812 00:05:01.056248 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.056249 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.056260 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.056309 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.056815 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.057304 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.058226 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.058458 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.058517 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:01.061614 (+ 3097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:01.061616 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:01.061616 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:01.061626 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:01.063408 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.063984 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.063986 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.063986 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.064063 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.064645 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.064647 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.064647 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.064871 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:01.064949 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:01.065443 (+ 494us) server_negotiation.cc:299] Negotiation successful
0812 00:05:01.065586 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 00:05:01.065806 30940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:01.055877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.126:37707 (local address 127.0.0.1:38580)
0812 00:05:01.056062 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:01.056099 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:01.056172 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:01.056334 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:01.056337 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:01.056628 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:01.056725 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:01.056730 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.057387 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.057388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:01.058155 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:01.058158 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.058538 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.058539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:01.058616 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:01.059203 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:01.059214 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:01.061409 (+ 2195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:01.063546 (+ 2137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:01.063556 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:01.063560 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:01.063889 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:01.064229 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:01.064231 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:01.064232 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:01.064513 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:01.064980 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:01.064990 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:01.065225 (+ 235us) client_negotiation.cc:769] Sending connection context
0812 00:05:01.065329 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 00:05:01.065522 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":94,"threads_started":1}
I20260812 00:05:01.066545 30939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:01.054436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49880 (local address 127.25.103.124:36771)
0812 00:05:01.054659 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.054668 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.054694 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:05:01.055262 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.055270 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.055322 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.055451 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.056256 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.057167 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.057917 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.058309 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.058420 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:01.062147 (+ 3727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:01.062170 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:01.062171 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:01.062184 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:01.064248 (+ 2064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.064759 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.064764 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.064764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.064832 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.065205 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.065207 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.065207 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.065536 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:01.065733 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:01.066322 (+ 589us) server_negotiation.cc:299] Negotiation successful
0812 00:05:01.066448 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":173,"thread_start_us":135,"threads_started":1}
I20260812 00:05:01.066998 30933 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:05:01 dist-test-slave-vpvm krb5kdc[30567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493100, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.124@KRBTEST.COM for kudu/127.25.103.125@KRBTEST.COM
Aug 12 00:05:01 dist-test-slave-vpvm krb5kdc[30567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.126@KRBTEST.COM
I20260812 00:05:01.076138 30821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:01.067499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47744 (local address 127.25.103.125:39329)
0812 00:05:01.067581 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.067584 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.067594 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:05:01.067625 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.067626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.067637 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.067690 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.068045 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.068735 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.069667 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.070073 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.070159 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:01.072681 (+ 2522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:01.072684 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:01.072685 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:01.072696 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:01.074797 (+ 2101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.075261 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.075263 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.075263 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.075323 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.075581 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.075582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.075582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.075737 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:01.075789 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:01.075950 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 00:05:01.076042 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 00:05:01.076182 30940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:01.067421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.125:39329 (local address 127.0.0.1:47744)
0812 00:05:01.067497 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:01.067509 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:01.067554 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:01.067751 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:01.067752 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:01.067891 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:01.067949 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:01.067951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.068848 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.068850 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:01.069554 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:01.069556 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.070253 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.070254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:01.070371 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:01.070966 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:01.070971 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:01.072555 (+ 1584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:01.074946 (+ 2391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:01.074948 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:01.074949 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:01.075188 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:01.075414 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:01.075415 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:01.075416 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:01.075507 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:01.075801 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:01.075802 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:01.075853 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 00:05:01.075920 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 00:05:01.076048 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 00:05:01.076603 30933 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:05:01.077191 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:01.067724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38592 (local address 127.25.103.126:37707)
0812 00:05:01.067797 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.067799 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.067806 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:05:01.067829 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.067830 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.067838 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.067883 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.068570 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.069198 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.070332 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.070589 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.070661 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:01.073140 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:01.073142 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:01.073143 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:01.073151 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:01.074964 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.075401 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.075403 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.075403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.075494 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.075713 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.075713 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.075713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.075850 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:01.076907 (+ 1057us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:01.076952 (+ 45us) server_negotiation.cc:299] Negotiation successful
0812 00:05:01.077034 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
Aug 12 00:05:01 dist-test-slave-vpvm krb5kdc[30567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493100, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.124@KRBTEST.COM for kudu/127.25.103.124@KRBTEST.COM
Aug 12 00:05:01 dist-test-slave-vpvm krb5kdc[30567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.103.125@KRBTEST.COM
I20260812 00:05:01.083575 30940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:01.076885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36771 (local address 127.0.0.1:49888)
0812 00:05:01.076928 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:01.076939 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:01.076974 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:01.077113 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:01.077114 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:01.077345 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:01.077398 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:01.077401 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.078324 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.078324 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:01.078815 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:01.078816 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.079209 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.079210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:01.079259 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:01.079668 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:01.079672 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:01.081027 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:01.082591 (+ 1564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:01.082592 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:01.082593 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:01.082760 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:01.082934 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:01.082934 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:01.082935 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:01.082987 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:01.083218 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:01.083219 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:01.083259 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 00:05:01.083322 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:05:01.083458 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":3}
I20260812 00:05:01.083629 30939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:01.076919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49888 (local address 127.25.103.124:36771)
0812 00:05:01.077026 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.077027 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.077031 (+ 4us) server_negotiation.cc:407] Connection header received
0812 00:05:01.077043 (+ 12us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.077043 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.077050 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.077082 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.077472 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.078246 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.078890 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.079143 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.079205 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:01.081105 (+ 1900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:01.081106 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:01.081106 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:01.081113 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:01.082521 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.082828 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.082829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.082830 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.082882 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.083037 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.083038 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.083038 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.083164 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:01.083221 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:01.083346 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 00:05:01.083520 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":97,"server-negotiator.queue_time_us":96}
I20260812 00:05:01.083900 30816 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } attempt: 3
I20260812 00:05:01.085589 30821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:01.077882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47758 (local address 127.25.103.125:39329)
0812 00:05:01.077918 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.077920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.077927 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:05:01.078001 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.078002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.078012 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.078066 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.078575 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.079008 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.079717 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.079927 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.079980 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:01.082047 (+ 2067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:01.082049 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:01.082049 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:01.082057 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:01.084237 (+ 2180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.084712 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.084714 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.084714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.084781 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.084969 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.084970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.084970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.085143 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:01.085352 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:01.085401 (+ 49us) server_negotiation.cc:299] Negotiation successful
0812 00:05:01.085496 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 00:05:01.085695 30933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767: Bootstrap starting.
I20260812 00:05:01.086896 30933 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:01.087257 30933 log.cc:824] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:01.087417 26013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:05:01.088446 30933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767: No bootstrap required, opened a new log
Aug 12 00:05:01 dist-test-slave-vpvm krb5kdc[30567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493100, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.125@KRBTEST.COM for kudu/127.25.103.124@KRBTEST.COM
I20260812 00:05:01.088748 30661 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38592
I20260812 00:05:01.090530 30933 raft_consensus.cc:348] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } } peers { permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } } peers { permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } }
I20260812 00:05:01.090746 30933 raft_consensus.cc:729] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b008f47556be4fdfb3074c7be11b3767, State: Initialized, Role: FOLLOWER
I20260812 00:05:01.090865 30933 consensus_queue.cc:260] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } } peers { permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } } peers { permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } }
I20260812 00:05:01.091277 30933 sys_catalog.cc:564] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:01.091230 30947 sys_catalog.cc:455] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } } peers { permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } } peers { permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } } }
I20260812 00:05:01.091341 30947 sys_catalog.cc:458] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:05:01.092577 30939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:01.084308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49892 (local address 127.25.103.124:36771)
0812 00:05:01.084375 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.084377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.084447 (+ 70us) server_negotiation.cc:407] Connection header received
0812 00:05:01.084514 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.084515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.084529 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.084590 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.084912 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.085617 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.086736 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.086963 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.087294 (+ 331us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:01.089332 (+ 2038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:01.089334 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:01.089335 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:01.089343 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:01.091144 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.091646 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.091648 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.091648 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.091714 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.091911 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.091912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.091912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.092105 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:01.092173 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:01.092378 (+ 205us) server_negotiation.cc:299] Negotiation successful
0812 00:05:01.092476 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:05:01.092592 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:01.084254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36771 (local address 127.0.0.1:49892)
0812 00:05:01.084366 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:01.084381 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:01.084441 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:01.084612 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:01.084614 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:01.084779 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:01.084833 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:01.084835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.085904 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.085906 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:01.086637 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:01.086639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.087050 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.087052 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:01.087118 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:01.087618 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:01.087624 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:01.089237 (+ 1613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:01.091281 (+ 2044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:01.091283 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:01.091283 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:01.091539 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:01.091777 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:01.091778 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:01.091778 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:01.091844 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:01.092190 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:01.092191 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:01.092254 (+ 63us) client_negotiation.cc:769] Sending connection context
0812 00:05:01.092339 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 00:05:01.092486 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
W20260812 00:05:01.093776 30966 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:05:01.093827 30966 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:05:01.094723 30816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953: Bootstrap starting.
I20260812 00:05:01.095562 30816 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:01.095870 30816 log.cc:824] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:01.093631 30827 master_runner.cc:186] Error getting master registration for 127.25.103.126:37707: OK, instance_id { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" instance_seqno: 1786493100676020 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:05:01.096011 30827 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:05:01.096837 30816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953: No bootstrap required, opened a new log
I20260812 00:05:01.099069 30816 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } } peers { permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } } peers { permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } }
I20260812 00:05:01.099261 30816 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37d977f472be433097ae3d78ff4f0953, State: Initialized, Role: FOLLOWER
I20260812 00:05:01.099346 30816 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } } peers { permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } } peers { permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } }
I20260812 00:05:01.099790 30816 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:01.099817 30970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } } peers { permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } } peers { permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } } }
I20260812 00:05:01.100000 30970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 00:05:01.102032 30990 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:05:01.102108 30990 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:05:01.102370 30711 master_runner.cc:186] Error getting master registration for 127.25.103.126:37707: OK, instance_id { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" instance_seqno: 1786493100676020 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:05:01.105557 30711 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:05:01.126551 30704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } attempt: 3
Aug 12 00:05:01 dist-test-slave-vpvm krb5kdc[30567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493100, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.103.126@KRBTEST.COM for kudu/127.25.103.124@KRBTEST.COM
I20260812 00:05:01.136337 30939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:01.127155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49902 (local address 127.25.103.124:36771)
0812 00:05:01.127208 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.127210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.127220 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:05:01.127251 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.127252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.127264 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.127326 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.127736 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.128511 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.129771 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.130141 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.130223 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:01.133195 (+ 2972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:01.133197 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:01.133197 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:01.133206 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:01.134987 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.135487 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.135488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.135488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.135560 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.135758 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.135758 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.135759 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.135914 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:01.135985 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:01.136137 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 00:05:01.136232 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:05:01.136348 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:01.127005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.103.124:36771 (local address 127.0.0.1:49902)
0812 00:05:01.127071 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:01.127088 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:01.127159 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:01.127332 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:01.127333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:01.127578 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:01.127643 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:01.127645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.128660 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.128663 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:01.129599 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:01.129604 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.130310 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.130313 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:01.130398 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:01.130946 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:01.130952 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:01.133060 (+ 2108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:01.135116 (+ 2056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:01.135117 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:01.135118 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:01.135391 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:01.135627 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:01.135628 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:01.135628 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:01.135696 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:01.135973 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:01.135974 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:01.136036 (+ 62us) client_negotiation.cc:769] Sending connection context
0812 00:05:01.136107 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 00:05:01.136237 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 00:05:01.138700 30704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1: Bootstrap starting.
I20260812 00:05:01.139528 30704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:01.139837 30704 log.cc:824] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:01.140910 30704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1: No bootstrap required, opened a new log
I20260812 00:05:01.142458 30704 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } } peers { permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } } peers { permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } }
I20260812 00:05:01.142642 30704 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8daa03e8ba6a402fbfc30f6abfb401a1, State: Initialized, Role: FOLLOWER
I20260812 00:05:01.142731 30704 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } } peers { permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } } peers { permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } }
I20260812 00:05:01.143088 30704 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:01.143170 30661 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 00:05:01.143253 30661 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:01.144141 30661 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } } peers { permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } } peers { permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } }
I20260812 00:05:01.144848 30780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "37d977f472be433097ae3d78ff4f0953"
I20260812 00:05:01.144975 30780 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953 [term 0 FOLLOWER]: Advancing to term 1
W20260812 00:05:01.145303 31009 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:05:01.145352 31009 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:05:01.145869 30780 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8daa03e8ba6a402fbfc30f6abfb401a1 in term 1.
I20260812 00:05:01.146647 30894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b008f47556be4fdfb3074c7be11b3767"
I20260812 00:05:01.146795 30894 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:01.147703 30894 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8daa03e8ba6a402fbfc30f6abfb401a1 in term 1.
I20260812 00:05:01.148399 30613 leader_election.cc:302] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8daa03e8ba6a402fbfc30f6abfb401a1, b008f47556be4fdfb3074c7be11b3767; no voters:
I20260812 00:05:01.151113 30587 master_runner.cc:263] No leader master found from master 8daa03e8ba6a402fbfc30f6abfb401a1
I20260812 00:05:01.151180 30587 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:05:01.144423 30661 leader_election.cc:288] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [CANDIDATE]: Term 1 election: Requested vote from peers 37d977f472be433097ae3d78ff4f0953 (127.25.103.125:39329), b008f47556be4fdfb3074c7be11b3767 (127.25.103.124:36771)
I20260812 00:05:01.153370 31011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } } peers { permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } } peers { permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } } }
I20260812 00:05:01.153731 31011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:05:01.153848 31011 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:01.153990 31011 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [term 1 LEADER]: Becoming Leader. State: Replica: 8daa03e8ba6a402fbfc30f6abfb401a1, State: Running, Role: LEADER
I20260812 00:05:01.154158 31011 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } } peers { permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } } peers { permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } }
I20260812 00:05:01.155299 30994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8daa03e8ba6a402fbfc30f6abfb401a1. Latest consensus state: current_term: 1 leader_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } } peers { permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } } peers { permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } } }
I20260812 00:05:01.155406 30994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:01.166136 31023 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:01.166429 31023 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:01.171890 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:01.152772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38606 (local address 127.25.103.126:37707)
0812 00:05:01.152819 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.152821 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.155199 (+ 2378us) server_negotiation.cc:407] Connection header received
0812 00:05:01.155303 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.155304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.155315 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.155344 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.157220 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.158020 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.161174 (+ 3154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.161679 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.161789 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:01.166382 (+ 4593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:01.166385 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:01.166385 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:01.166394 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:01.168156 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.168576 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.168578 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.168578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.168638 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.170930 (+ 2292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.170931 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.170931 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.171111 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:01.171190 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:01.171692 (+ 502us) server_negotiation.cc:299] Negotiation successful
0812 00:05:01.171784 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:05:01.173648 30939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:01.153129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49904 (local address 127.25.103.124:36771)
0812 00:05:01.153167 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.153169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.156347 (+ 3178us) server_negotiation.cc:407] Connection header received
0812 00:05:01.156442 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.156443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.156455 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.156484 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.158603 (+ 2119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.159373 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.162755 (+ 3382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.163086 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.163153 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:01.168738 (+ 5585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:01.168740 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:01.168741 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:01.168750 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:01.170381 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.171395 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.171397 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.171397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.171460 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.172961 (+ 1501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.172962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.172963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.173136 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:01.173235 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:01.173457 (+ 222us) server_negotiation.cc:299] Negotiation successful
0812 00:05:01.173548 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 00:05:01.173714 30619 tablet.cc:2369] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:05:01.174633 30821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:01.154526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47760 (local address 127.25.103.125:39329)
0812 00:05:01.154573 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.154575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.166143 (+ 11568us) server_negotiation.cc:407] Connection header received
0812 00:05:01.166256 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.166258 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.166271 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.166301 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.166979 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.167723 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.169350 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:01.169700 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:01.169747 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:01.171238 (+ 1491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:01.171240 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:01.171240 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:01.171248 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:01.173229 (+ 1981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.173685 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.173687 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.173687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.173758 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:01.173998 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:01.173999 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:01.174000 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:01.174139 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:01.174227 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:01.174452 (+ 225us) server_negotiation.cc:299] Negotiation successful
0812 00:05:01.174541 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:05:01.174860 30894 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767 [term 1 FOLLOWER]: Refusing update from remote peer 8daa03e8ba6a402fbfc30f6abfb401a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:01.175247 30994 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:01.175396 30780 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953 [term 1 FOLLOWER]: Refusing update from remote peer 8daa03e8ba6a402fbfc30f6abfb401a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:01.175968 30994 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:01.176849 30947 sys_catalog.cc:455] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8daa03e8ba6a402fbfc30f6abfb401a1. Latest consensus state: current_term: 1 leader_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } } peers { permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } } peers { permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } } }
I20260812 00:05:01.176946 30947 sys_catalog.cc:458] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:05:01.177906 30970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8daa03e8ba6a402fbfc30f6abfb401a1. Latest consensus state: current_term: 1 leader_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } } peers { permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } } peers { permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } } }
I20260812 00:05:01.178047 30970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:05:01.178399 31011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } } peers { permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } } peers { permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } } }
I20260812 00:05:01.178505 31011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:01.178576 31024 mvcc.cc:205] Tried to move back new op lower bound from 7317475742409859072 to 7317475742330114048. Current Snapshot: MvccSnapshot[applied={T|T < 7317475742409859072}]
I20260812 00:05:01.178617 30947 sys_catalog.cc:455] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } } peers { permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } } peers { permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } } }
I20260812 00:05:01.178700 30947 sys_catalog.cc:458] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:05:01.179677 31025 mvcc.cc:205] Tried to move back new op lower bound from 7317475742409859072 to 7317475742330114048. Current Snapshot: MvccSnapshot[applied={T|T < 7317475742409859072}]
I20260812 00:05:01.180269 31023 catalog_manager.cc:1347] Generated new cluster ID: 5ceaf7b162af43fe8bac05e31f406c48
I20260812 00:05:01.180318 31023 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:01.182816 30994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } } peers { permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } } peers { permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } } }
I20260812 00:05:01.182983 30994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:01.184219 30970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8daa03e8ba6a402fbfc30f6abfb401a1" member_type: VOTER last_known_addr { host: "127.25.103.126" port: 37707 } } peers { permanent_uuid: "37d977f472be433097ae3d78ff4f0953" member_type: VOTER last_known_addr { host: "127.25.103.125" port: 39329 } } peers { permanent_uuid: "b008f47556be4fdfb3074c7be11b3767" member_type: VOTER last_known_addr { host: "127.25.103.124" port: 36771 } } }
I20260812 00:05:01.184309 30970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:05:01.184801 31027 mvcc.cc:205] Tried to move back new op lower bound from 7317475742409859072 to 7317475742330114048. Current Snapshot: MvccSnapshot[applied={T|T < 7317475742409859072}]
I20260812 00:05:01.197435 31023 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:01.198647 31023 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:01.203873 31023 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8daa03e8ba6a402fbfc30f6abfb401a1: Generated new TSK 0
I20260812 00:05:01.204227 31023 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:05:01.237918 30707 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:01.236400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38610 (local address 127.25.103.126:37707)
0812 00:05:01.236451 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.236453 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.237117 (+ 664us) server_negotiation.cc:407] Connection header received
0812 00:05:01.237238 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.237240 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.237253 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.237286 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.237822 (+ 536us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38610: BlockingRecv error: recv got EOF from 127.0.0.1:38610 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260812 00:05:01.239187 30939 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:01.236785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49916 (local address 127.25.103.124:36771)
0812 00:05:01.236826 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.236828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.238589 (+ 1761us) server_negotiation.cc:407] Connection header received
0812 00:05:01.238688 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.238689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.238703 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.238733 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.239115 (+ 382us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49916: BlockingRecv error: recv got EOF from 127.0.0.1:49916 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 00:05:01.239997 30821 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:01.238277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47774 (local address 127.25.103.125:39329)
0812 00:05:01.238324 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.238327 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.239414 (+ 1087us) server_negotiation.cc:407] Connection header received
0812 00:05:01.239514 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.239516 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.239527 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.239557 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.239932 (+ 375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47774: BlockingRecv error: recv got EOF from 127.0.0.1:47774 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260812 00:05:01.242228 30821 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:01.241444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47788 (local address 127.25.103.125:39329)
0812 00:05:01.241481 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.241482 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.241663 (+ 181us) server_negotiation.cc:407] Connection header received
0812 00:05:01.241760 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.241762 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.241782 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.241810 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.242178 (+ 368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47788: BlockingRecv error: recv got EOF from 127.0.0.1:47788 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260812 00:05:01.246069 30821 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:01.245129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47804 (local address 127.25.103.125:39329)
0812 00:05:01.245170 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.245172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.245425 (+ 253us) server_negotiation.cc:407] Connection header received
0812 00:05:01.245525 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.245526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.245553 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.245589 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.246013 (+ 424us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47804: BlockingRecv error: recv got EOF from 127.0.0.1:47804 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 00:05:01.250936 30821 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:01.249515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47808 (local address 127.25.103.125:39329)
0812 00:05:01.249566 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.249568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.249836 (+ 268us) server_negotiation.cc:407] Connection header received
0812 00:05:01.250001 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.250002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.250017 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.250050 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.250865 (+ 815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47808: BlockingRecv error: recv got EOF from 127.0.0.1:47808 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260812 00:05:01.258500 30821 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:01.257004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47818 (local address 127.25.103.125:39329)
0812 00:05:01.257072 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.257075 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.257620 (+ 545us) server_negotiation.cc:407] Connection header received
0812 00:05:01.257747 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.257749 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.257764 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.257796 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.258430 (+ 634us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47818: BlockingRecv error: recv got EOF from 127.0.0.1:47818 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260812 00:05:01.269050 30821 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:01.268118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47822 (local address 127.25.103.125:39329)
0812 00:05:01.268171 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.268174 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.268441 (+ 267us) server_negotiation.cc:407] Connection header received
0812 00:05:01.268538 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.268539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.268550 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.268578 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.268985 (+ 407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47822: BlockingRecv error: recv got EOF from 127.0.0.1:47822 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260812 00:05:01.287474 30821 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:01.286591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47834 (local address 127.25.103.125:39329)
0812 00:05:01.286636 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.286638 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.286873 (+ 235us) server_negotiation.cc:407] Connection header received
0812 00:05:01.286985 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.286986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.286997 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.287025 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.287408 (+ 383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47834: BlockingRecv error: recv got EOF from 127.0.0.1:47834 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 00:05:01.321739 30821 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:01.321123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47836 (local address 127.25.103.125:39329)
0812 00:05:01.321201 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.321204 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.321214 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:05:01.321267 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.321268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.321280 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.321329 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.321675 (+ 346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47836: BlockingRecv error: recv got EOF from 127.0.0.1:47836 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260812 00:05:01.388130 30821 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:01.387311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47840 (local address 127.25.103.125:39329)
0812 00:05:01.387419 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.387422 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.387563 (+ 141us) server_negotiation.cc:407] Connection header received
0812 00:05:01.387645 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.387646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.387660 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.387712 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.388071 (+ 359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47840: BlockingRecv error: recv got EOF from 127.0.0.1:47840 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260812 00:05:01.518783 30821 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:01.518032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47846 (local address 127.25.103.125:39329)
0812 00:05:01.518132 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.518135 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.518173 (+ 38us) server_negotiation.cc:407] Connection header received
0812 00:05:01.518277 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.518279 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.518292 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.518340 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.518717 (+ 377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47846: BlockingRecv error: recv got EOF from 127.0.0.1:47846 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260812 00:05:01.776863 30821 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:01.776257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47860 (local address 127.25.103.125:39329)
0812 00:05:01.776320 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:01.776322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:01.776331 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:01.776361 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:01.776362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:01.776374 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:01.776427 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:01.776800 (+ 373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47860: BlockingRecv error: recv got EOF from 127.0.0.1:47860 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:05:02.094326 30966 catalog_manager.cc:1259] Loaded cluster ID: 5ceaf7b162af43fe8bac05e31f406c48
I20260812 00:05:02.094417 30966 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767: loading cluster ID for follower catalog manager: success
I20260812 00:05:02.095252 30966 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767: acquiring CA information for follower catalog manager: success
I20260812 00:05:02.095556 30966 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b008f47556be4fdfb3074c7be11b3767: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:05:02.102593 30990 catalog_manager.cc:1259] Loaded cluster ID: 5ceaf7b162af43fe8bac05e31f406c48
I20260812 00:05:02.102694 30990 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953: loading cluster ID for follower catalog manager: success
I20260812 00:05:02.103924 30990 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953: acquiring CA information for follower catalog manager: success
I20260812 00:05:02.104465 30990 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 37d977f472be433097ae3d78ff4f0953: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:05:02.294258 31146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:02.290494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47874 (local address 127.25.103.125:39329)
0812 00:05:02.290787 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:02.290790 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:02.290808 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:05:02.290843 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:02.290844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:02.290907 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:02.291143 (+ 236us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:02.291370 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:02.292144 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:02.293107 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:02.293395 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:02.293484 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:02.293761 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:02.293903 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:02.294008 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:02.294120 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 00:05:02.294155 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":121,"threads_started":1}
I20260812 00:05:02.298746 31152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:02.296271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49930 (local address 127.25.103.124:36771)
0812 00:05:02.296402 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:02.296404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:02.296411 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:05:02.296452 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:02.296452 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:02.296493 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:02.296566 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:02.296689 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:02.297193 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:02.297935 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:02.298177 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:02.298235 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:02.298408 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:02.298528 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:02.298608 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:02.298625 (+ 17us) server_negotiation.cc:299] Negotiation successful
0812 00:05:02.298652 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":64,"threads_started":1}
I20260812 00:05:02.304670 31146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:02.300999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47882 (local address 127.25.103.125:39329)
0812 00:05:02.301085 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:02.301088 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:02.301157 (+ 69us) server_negotiation.cc:407] Connection header received
0812 00:05:02.301273 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:02.301275 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:02.301289 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:02.301356 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:02.301544 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:02.302297 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:02.303758 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:02.304055 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:02.304123 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:02.304329 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:02.304383 (+ 54us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:02.304435 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:02.304526 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 00:05:02.304565 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 00:05:02.305156 31152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:02.301627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49938 (local address 127.25.103.124:36771)
0812 00:05:02.301682 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:02.301684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:02.301692 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:02.301733 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:02.301734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:02.301742 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:02.301796 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:02.302037 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:02.302862 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:02.303912 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:02.304209 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:02.304273 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:02.304464 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:02.304511 (+ 47us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:02.304551 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:02.305014 (+ 463us) server_negotiation.cc:299] Negotiation successful
0812 00:05:02.305062 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:05:02.305622 31164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:02.301486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38624 (local address 127.25.103.126:37707)
0812 00:05:02.301643 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:02.301645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:02.301654 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:02.301700 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:02.301701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:02.301760 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:02.301888 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:02.302063 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:02.302632 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:02.303836 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:02.304257 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:02.304367 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:02.304565 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:02.304715 (+ 150us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:02.304785 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:02.305483 (+ 698us) server_negotiation.cc:299] Negotiation successful
0812 00:05:02.305533 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":80,"threads_started":1}
I20260812 00:05:02.307461 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 30587
I20260812 00:05:02.337924 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 30711
I20260812 00:05:02.350075 26013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdkQn2d/build/release/bin/kudu with pid 30827
2026-08-12T00:05:02Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3176 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6171 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (300030 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST